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ABSTRACT * 

As in any very large suijvey, the sample .that provided 
the National Longitudinal Study of the High School Class of 
differed from the random sample of thfe sttjidy design 
nonresi^onse from 226 of the 1,2p0 schools in the primary 
sample, and a small amount of other missing data. Part A of this 
report, briefly describes the design of the sample, including , . 
provisioBS, fox selecting alternate schools for those that declined to 
participate, the detailed stratification plan, and an overview of the 
project. Part B presents a synopsxa of the findings which indicated, 
that the majority of the estimated totals for the base year survey 
were significantly biased by the lack of data- from the nonrespqnding 
schools. , This coAclusioa is based on data from the first follow-up 
survey of 1973 which re^duced the nonresponse. rate to a minimal two 
percent^ Part* C describees the ''methodology and assumptions of the , 
statistical procedures used in es,timating the bias rejsulting frow 
nonresponse. Part D tabulates the statistical results- of this study. 
The appendix provides an alternative methodology for estimating bias 
in the base year statistics. (CTM) . 
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■ . ' A. INTRODUCTIOM - . v- 

' In 1969. £he National Center for Educational Statistics (NCES), began ; ^ 
planning for a national longitudinal, survey of -high school, graduates as' tH6y 
first in a. series of longitudinal studies of educational effects. Basic to 
the planning was the selection of a representative ^ sample d£, students to be 
traced through their post-secondary education br training and then followed 
f.or. some time after their entrance into the Job market... The present volume 
rela,tes -to some of .the initial results of this survey, specifically, the base ^ 
year (BY) estimates, for the National Longitudinal Study of the High- School - 
Class of 1972 (NLS) . Especially; ' thi^' volume addresses estimation bidses 
that apparently have^^result^^ froftt effort^- to account for t^ose schools in , 
the sample that did not cooperate in the BY survey. 

The primary purpose of NLS is to 'discover what happens to young people 
after thiey leave high school (as measured by their subsequent .educational 
-and vdcational activities, plans, aspirations and attitudes) and to relate 
this infomjation to their prior educational experiencea^and personal and 
b'iographical charact^tistics. tlltim^fely, the study will allow a better 
understanding'of -^^the development of students as they pass through the American 
educational system and of the complex factors associated with individual 
educational atid career outcomes. ^ Such informatioa^is essential as a basis 
for effective planning, implementation, and evaluation of Fediral policies 
*and programs /that are designed to enhance educational' opportunity and achieve- 
'ment and to/upgrade occupational attainment and career outcome. ; 

A pi/ot phase of the NLS study was conducted in 1971 by Research 
Triangl^ Institute. This phase involved the development and field test 
of instruments and procedures for the BY survey. The sampling of schools 
was <iesigned and executed by WESTAT Incorporated. l^STAT also developed 
th^initial weights needecf to account for unequal sampling rates (these 
Rights are termed the unadjusted school weights). Then,, in January 1972, 
Educational Testing Service and NCES jointly undertook the full-scale 
BY survey; it was completed June 30,' 1973. This effort involved the 
completion of several. instruments . The major instruments consist of 
student, counselor, and school questionnaires, student test booklets, 
and student^s school record information forms. The first follow-up 



data collefction effort (FFU). was begun in October 19?3 and- was corjplete^i 
In April 1974. The instVumehts used in- the FFU survey^are termed a Form A 
Student Questionnair;e for most students responding in the BY and. a Form B 
Student Questionnaire. for students from schools that did. not participate ; 
in the base year. Form B was also administered to a subsample of 500 students' 
who responded in the BY survey. At the-time of this writing, the second 
follow-up data collection effort, which began in OctbKer 1974, has been 
completed and is presently being summarized, i 

The student questiont^Ljtffe dat^ are the major concern^ of the present 
investigation, but the contexts of all^urvey instruments listed above are 
briefly described here to. point up the scope of NLS. The test booklets 
contained short (five to ten minute)* tests, of student ability in six subject 
areas: (1) vocabulary, (2) reading, (3) mathematics, (4) letter groups 
[inductive reasoning]-, (5) mosaic comparisonrs [perception], and t6)'picture - . 
number {association- memory] . The Student Questionnaire, which was to be 
completed by each sample student, consisted of 104 qtfestions about myriad ^ 
student-xelated factors; such as, ability, socioeconomic status, aspirations, 
values, religion, ethiaicity, and high school expe*riences. Counselors, on 
the counselor questionnaire, were ^queried about their characteristics; workloa4s; 
and counseling experiences , practices , and facilities . School records and, 
if needed, student Interviews were u^ed to complete questions on the student's ^ 
school, record information form (SRIF) . .The SRIF contained questions about 



'^^he sample students; such as, name, address., class rank, grade average. 

Standardized test scores, transfer status, and major curriculum. The school 
questionnaires were usually completed with the assistance .erf the school's 

• aifminis'trative staff and dealt with information about enrollment, staff. 



and educational practices, for example. In the FFU, Form A was administered 
to sample students that participate in the BY survey,, and contained. 85 
questions about j>ost'^gr§duat±5n activities and aspirations. Form B, which 
was mailed to students that did. not participa^te .in BY, \ contained the same 
85 questions and, additionally, 14 questions abouff information th^t was 
initially- sought in the BY survey. *^This additional "'Information obtained 
from students in ^**nonrespondent** schools is particularly instrumental in 
the present investigation of- bias in BY statistics . 
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1. Sample Peslgn - , . ' - 

The sample design may be described as a deeply stratfifled two-stage ^' 
probability srfmple with schoolq^as first-stage s>ampling units an^ Students :^ 
(also« guidance counselors)' as second-stage units. Th^ target population - 
consists of all 197^ twelfth? graders enrolled in air public, priv£^e, and 
church-affiliated high schools in the- 50 States and tHe District of ^olumbia.- 
The first-stage sampling frame was constructed .from computerized school 
files maintainejd by the United States Office -of Education and by^ the National ^ 
CathckLic Educational elation. 

Xhe school • sampling frame yas stratified into '289 major strata based 

on the following variables: ' ^ > 

• * 

- Type of control (public or i^onpubli^) , _ 
-Geographic region (Northeast, Nor.th^Cen^ral, South, and West), 

' - Grade 12 enrollment (less than 300; 300 ,to 599;- 600 oxjjore) , 

- Proximity to institutions of higher learning (three categories)., 

- Percentage minority group ehrollment (eight levels) , and 

- Income level of the community (11' categories for public schools, 

8 categories* for Catholic schools, and. a single category for other 

^ * i» • 
schools). , . ■ 

Then, on phe basis, of the degree of urbanization, one or more ffnal strata 
were defined within each major stratum to generate a total of 600 final 

strati,' ' . ] . . -^"^ 

In order to increase the numbers of disadvantaged students in the sample, 
schools located in .low-income areas and schools with high prqportions of 
'minority group enrollments were samjJled at 'dpproxiraately .twice the sampling 
rate used for the remai4iing schools. Schools in the smallest-^etyrollment 
strata (le^ss th^ 300 seniors) were selected with probabilities prpportioxjal 
^to their estimat'ed numbe.jrs of senior studenfes and without -replacement. Schools 
in tl}e reaaining strata were selected with equal probabilities and without 
repla(:ement • Within each final stratum, four schools were selected initially, 
and then two' of the four were randomly designated as the primary selections. 
The other two schools were retained as backup- or substitute selections and' 
were used in the sample only if one or both of- the primary schools did nljt * 
cooperate (for example , ^closed , refused, or ineligible ; -ineligible relates * 



here to^schools for handicapped or legally confined students or that did 

not. enroll students of their own). ^ Five strata comprised exceptions to 

this methodology because they contained only three schools each. Samples 

of 18 students and two counselors, pj^r school were selected;- five additional 

* ' ' * ' ' ' " % 

students and one additional counselor were selected as alternates- 

Students and counselors were selected from' each sample school with equal 

^'proibabilities and without replacement. > '-^ 

Thus, the primary sample consi3teeK initially of 1,200 schools (two 
per stratum), as many as 2,400 counselors (two per sample school), and 
as many as 21,600 stxjdents (iS. per sample schopl) . For schools, however, 
the sample ha^ ultimately involved secondary -gchools selected in place 
of primary schools that did not cooperate or had^no eligible seniors; 
tertiary schoo]^s used to replace secondary scliools that did noC* cooperate 
or had no eligible seniors; augmentation schools, 16 schools in strata 
601-608 used t6 account for incompleteness in the original sampling 
frame; the occurrence of "extra" schools or schools in excess of the • 
intended sample of two per stratum; and, in the FFU, "res'upvey schools" 
or noncoop'erati-ng BY sample schools (largely primary schools) , which 
were surveyed during the FFU to obtain both current and retrospective 
data. In the BY survey, .16,409 students f^m 974 sample schools completed 
the Student Questionnaire (974 921 primary schools + 53 backup s'chools 
and excluded the 18 "extra" schools). In the FFU survey, 21^350 students 
from 1,300 sample schools completed* FFU questionnaires (1, 300' = 1,153 
primary schools + 131 backup schools + 16 augmentation schools and 
excludes the 18 "extra" schools). 
2 . Study Overview 

Extimates based on the Stu4ent Questionnaire data of the NLS were 
influenced by noriresponse at^'eCeral levels of sample selection; for 
exanjple, 230 of the- initially selected schools declined to participate'; 
ap^roximatelvpne-tenth of the sample studenjts in cooperating schools 
failed^' to participate; and,, finally occasional item responses were 
missing for participating students (median nonresponse for individual 
items was 2 percent [ref. 5]). This paper presents methodology and 
results of an investigation of the possible influence of .school nonresponse 
on the NL1S initial Base' Year (BY) estimates. Overall or net bias (from 
alt sources): 4nd the extent;?' to which the class-adjusted weights domiciled 



on the Public Use Data File [ref • 1] account for bias were not addressed 
in this investigation; that is, although these topics appear worthy of 
consideration, they were not within the scope-of-work ifbr this stud 
School nonresponse relates here to those primary schools that eithe 
refused to participate in the BY survey or could not participate because 
th^ . Request was received too late. Summary findings an4 conclusions 
from this investigation are also presented in the FFU final report. Two 
methodologies for estimating bias, which were developed expressly fgr 
Chls analysis, are presented in Section C and the appendix* The ba^ic 
statistics resulting fr^om the method described in Section C are presented 
\ixi Section D and consist of the following estimates: 

- The^ number of seniors, estimated using the currently accepted 
number of 1972 seniors for the sample schools and the substitution 
and weighting methodology that were used in BY estimation (using 

•j data 'from 1,605 schools; 949 primary, 95 backup, and 21 with no 
seniors) ; ^ . ^ 

- The number of seniors that would respond to each category in each 
of 35 questions on the ^Student Questionnaire, estimated according 
to the substitution and weighting methodology and the student- 
response data that were used in BY estimation (using data from * ' - 
1,065 schools and 16,409 students;^ 16,409 Student Questionnaires 

were completed in the 1,065 schools with 91 of these sthools having 
no* completed Student Questionnaires) ; 

- The proportion of seniors that would respond to each of these 
question categories, calculated using BY methodology and data 
throughout (using data from 1,065 schodXs and 16,40,9 students); 

- The bias in each of the above BY estimates that resulted from ' 
substituting or otherwise accounting for nonparticipating schools 
(using data from 1,175 schools and 18,696 students to calculate the 
"best estimate" and from 1,065 schools and 16,409 students to 
calculate the base year estimates; 1,175 schools » 949 base year 
primaries, 21 primaries with no seniors, and 205 primaries from 
FFU; 18,696 seniors - 16,409 base year respondents, plus 3,144 from 
FFU primary schools, minus 857 from backup schools); 

- Standard deviations for each of these statistics (using the same 

data sets used to estimate bias). 
\ 

*Noting the substantially higher response rates in follow-up activities 
one might conjecture that inadequate lead time was the major cause of the 
school noijiresponse in the BY survey. 




These estimates are presented for each response category in each of 
thirty-five' questions, FFU Form B questions 78 and 86-99 (several .^re 
multiple-part questions). Note that the Form B designations serve only 
to identify the questions that were investigated in this analysis. 
Note^lso that the retrospective data obtained in the FFU Purvey are 
.reflected in the "best estimates,** but were not used ,to calculate base 
year estimates that are described , above, as "calculated using BY method 
ology and data throughout." 

The primary sources of informatioh used in this investigation 
consist of the NLS BY survey, 1972-73, and the' NLS FFU survey, 1973-74. 
Two components of the FFU survey, which are particularly useful in this 
analysis, relate to: (1) a subsample of 500 BY respondent students, who 
were asked to recall answers to the 35 qtiestions listed above, and (2) a 
complete follow-up of the nonparticipating BX schools (BY information 
was sought^from a sample of the 1972 seniors in these nonparticipating 
schools). Data used in this analysis, except for the indications of 
recall-bias obtained from the 500 subsampled students, were abstracted 
from the so-called *'master file** tape from which the Public Use Data 
File''[l] was prepared. ^ ■ 

As noted above, approximately lO percent of the inltlal-sa;mple 
(primary) schools declined to -participate' in the 1972 NLS survey-. This 
magnitude of nonrepqnse presents the potent laL^f or a substantial bias in 
the NLS BY' estimates. 

Two common procedures for dealing with the problems^f nonrespon'se 
involve: (1) the selection and use of substitute sample units, and 
(2) the adjustment of response weights. Both of these prpcedures were 
\used in the calculation of BY statistics. Each* stratum was assigned two 
primary schools and two backup schools, which were to be used if the 
primary schools declined to participate. If the combined solicitation 
of primary and backup schools failed to yield two cooperating schools in 
a stratum, weight adjustments, as opposed to* the solicitation of addi- 
tional backup schools, were used to account for 'the missing schools. 
These procedures, as they were used in the BY survey, relied on the use 
of substitutes that were similar in size, geographic location, and 
proximate population density to the npnrespondents, and the increase of 
weights of participating schools that were- likewise similar to non- 
participating ischools. 



In preview to the findings of the next section, the original BY 
estimates .relating t^each primary school are compared In this investl- 
gatlba with a so-called "best jestlmate." This comparison, or dlfferenc^, 
constitutes the basis for estimating the school nonresponse bias of the 
BY estimates. The orlglnaj. BY estimates for a particular primary school 
may be based on data from the BY response of that primary 'Schoo^, on the 
BY response of a substitute (backup)* school, or, Impllclty, on other BY 
responses through weight adjustments. • The "best estimate" ^s base<ij2)n 
the currently most reliable data about the' primary schools; for most NR 
schools In the BY, these data have been obtained retrospectively from \ 
the resurvey activity. The "best^ estimates" used In this Investigation 
do not, however, utilize certain recent refinements, such as, the 
weighting-class adjustments that were used to account for NR in the FFU 
estimates and the 16 augmentation schools that were used to accpunt for^ 
sampling-frame incompleteness. These refinements, . if ^ used to obtain 
these '-'best e^stimates," would' result more .nearly in estimates of the . 
overall bias as opposed to that resulting only from the school non- 
response, which we attempted to Isolate in thfs particular investigation. 
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' B. FINDINGS AND CONCLUSIONS: A SYNOPSIS 

!• Findings . . ^ . 

The results of this study should be vlewed^Wltb the awareness that 
several simplifying assumptions and approximations were fnvoked. While 
the accuracy of the inference statements to follow depend to some degree 
on the. validity of these assumptions and approximations, the results are 
so consistent and dramatic it is doubtful that a more refined analysis 
would alter the conclusions. On the other hand> considerable effort in* 
this investigation has been directed at minimizing errors. BY statistics 
wer^ recalculated and verified against previous tesults, and a test run 
of the computer Iprogram produced correct results for all items, according 
tb manual calculations, using actual data from more than 50 schools. 

The findings herein are couched latgely in the form of statistical 
inferences, recognizing that differences were sure to exist l^etween an 
initial sample of "^primary*' schools and a backup ^sample of substitutp schools, 
but that such differences might be largely attributable to sampling error . 
For each category of each question, the null hypothesis (H^) of negligible 
bias was tested at' three, significance levels, namely, a =» .10, .05, and 
.01 with two sided standard no'^mal critical regions. Table 1 presents a 
summary of these tests. The question-identification (BSYRQ) numbers correspond 
to the original base-year questionnaire. .The table reveals that thd vast 
majority of the estimated totals are significantly biased — mostly negatively. 
More noteworthy, however,* is the predominance of biases for estimated pro- 
portions because the BY statistics were presented as proportions or ratio 
estimates. Considering the. large number of hypotheses being tested 
(several categories for each of the 35 questions), one should expect to 

reiect H : BIAS = 0 a certain number of times even if the difference were 

o * ' — . 

attributable only to sampling error. It is use:^ul, therefore, to compare ^ 
the number of categories in which H is rejected versus the number of rejections 
that could be expected to result from the commission of type I(a ) errors. ^ . 
Ta^le 2 presents this comparison and reveals that was rejected far too 
of ten' to be accounted for entirely by a'erifor. For the .05 significance 
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Table 1. Frequency of .Significant 'Biases >in BY Estimates Related to 
' 35 Selected Questions on the NLS Student Questionnaire* 



BSYRQ 
Nwber 



Question 



Number Frequency o£. categories with significant bias** 
Estimated totals Estimated proportions 

categories . ■ , \ ^ 



0.1 



(high school program) 
(high school grades) 
(job time), 
(athleticsf) 
(cheerleader) 
(debating pr music) 
(hobby clubs) 
(honorary clubs) 
V (school newspaper or yearbook) 
(subject matter clubs) 
(student government) 
(vocational education clubs) 
(friends plans) 
(time of decision on college) 
(physical llmitat'ion) 
(race) 

(English spoken at home) 

(father's education) 

(mother's education) 

(father's aspirations for . 
student's education) 

(mother's aspirations £or 
student' s education) 

l^eligion) 

(parent income) 

(place for home study.) 

(daily newspaper) 

(dictionary) 

(encyclopedia) 

(magazines) . • 



8 
8 
8 

3 
3 
3 

. 3 
«3 

3 

3 

3" 

3 

8 

6 

2 

8 

2 

9 

9 



7 
6 
10 
2 
2 
2 
2 
2 



0 
1 
1 
0 
0 
0 
0 

1 

i , 

0 
0 
0 
0 
0 
0 

1 ^ 

1 

1 

0 



0 
0 
0 
0 
0 
0 
0 

1 



g "0.05 

3 . . 

6 5 

7 . 
3 

' 2 
2 
1 

. 1 

1 
2 
2 
4 
4 
1 
1 
1 
6 
8 



0.1 



"4 



5 . 

4 
0 

2 ' 

2 

1 



1 
1 
0 
0 
0 

1. 

0 
0 

b 

0 

0 
0 
0 
0 
0 
0 
0/ 



0 

1 

0 

0 
0 
0 
0 
0 



0.05 



3 
4 

0- 

0 

1 

0 

0 

0 

0 

0 

1 

0 

1 

3 
0 
4 
2 
4 
3 



0 
0 
0 
0 

0. 
0 
0 
0 




, -1<P ■ 



Table !• (contihued) 





" 1 




0^ . 


1 


V 


,0, • ^ 






n - 




2 




0* . , 




(color televiston). 


/ 

z 


0 4 


2 - 


6. 


(3 • 


941 


Q typewriter^ 


7 

f 


0 


2 


0 


0 


941 


(electric dfshwasher) 


2 


0 


2 


-0 


0 


94K 


(motor vehicles) 


2 


- 0 * ■ 


2 


0 

. > 


0 


95 


(type of connnunity) 


8 




_2 




_0 




Total 


155 


8 - 


91 - 

ii 




' 26 



*Based on data from the NLS BY; FFU, and Recall-Error surveys, ^972 and 1973; each 
rejected cat;egory is listed only qnce under the most^ powerful test that it passes. 

**The test statistic, ^^fr , is assumed to have approkimately the ^^tandard nojnnal 
distribution. . < r 



r 




Table 2, Frequency of Significant Biases in BY Estimates and 
F:requency of Biases that Might Be Erroneously Declaredl 
\ \ Significant ( a Error)* 



Type of ^ 
Estimator 


Sighif icance 
Level, 

a'. ' .1- ■■ , 


Biases Declared 
• Significant, 
Number 


^ ^ 

'»Expected Number * 

/ of Type I 
« ' Errors*^* 


Totals 


0.10 


99 \ •': 


./ 16 ■ ■ 


Proportions 


o.m 


• 33 ■ . 


. / , -16 . 


Totals^ ^* 


0.J35' 


' ' 91 . 


• 8 . 


Proportions 




26 


• 8 



■ *B4sed on. data from the NLS BY, FFU, and Recall-Error Surveys, 197 
and 1973. ' ' 



• * ■ • > 

' **Expected number of times H^: 3 =• 0 might be rejected because Type I 
<a) error is calculated as a times the total number of tests (155) . , 



level, for ,exampl;e, we would expect to reject approximately eight times 
each for totals and ratios if H were true, hut\ rather, we rejected H 91 
and ^6 times, respectively. ^ 

The estimated number of 1972 seniors, based on BY methodology and the 
presently accepted numbers of 19/2 seniors in sample schools, is indicated 
by this study to contain' a statistically-signifl^cant downward bias of five 
percent. Xhi^s bias suggei^ts that the larger schools were underfepresented 



as a result of substitution and weight-adjustment actions taken in 'the BY 



suit or su 
ins ate for 



to compensate for school NR, 



Biases and theit: implications can t>e i^alysed for each question individua 
from the istatistical results presented in Section D. Such individual-question 
analyses were not undertaken here. An example is presented, however, to 
demonstrate pertinent consideraticms regarding the biases and their magnitudes 
as they relate to the accuracy of BY estimation^ The first two BY questions 
that were studied, BSYRQ2 and BSYRQ5, are used for this example, but these 4 
two. questions are not particular]^, unique compared to the biases indicate^ / 
throughout the analysis. 

BSYRQ2 relates to "the student's high school program. The question 
and its. eight answer-categories are: ^ s 

Which of the following best describes your present high school^ program? 

■ ' (Circle one.) 

General. • ~. .. ^ ........ 1 ^ 

Academic or college preparatory 2 



IVqcational or technical: 



i\ Agricultural occupations 3 ' 

Business or office occupations ^4 

' D|.stributive education . 5 

" r " -^^ Health occupatUons . iS 



Home economics occupA^tl^ons 7 ^ 

Trad6^br industrial occupations. ..... 8 . . 

Recall frpm table 1 that thrjee categories for estimated tot;als and a 
fox^v for estimated proportions were significantly biased for this qu6i5^tion. 
Table 3 reveals that, for totals, categories 1, 2, and 4 are negatively 
^ased. The relative biases of these category totals range in magnitude ^ 
from a minus 3.4 percent for the numb answering ''Academic'' to a minus 



Table 3. Bias and Reliability for BY Estimates 
Related to BSYRQ2^ 



Question ^ '>^ype of > "Best 
Category • • Estimate Estimate 



Mb 



BY 



Estimate 



, Relative ' 
Bias in 

BY Estimate, 
^Percent 



/mse 

SE 

BY Estimate 



for 



Confidence Level 
^ . for,<the 
e + 1.96 SE 
» .Interval 



All., 
itegor: 

3 

,4 
5. 
6 
.7 
8 

1 
2 

3 - 

5 
6 
7 
8 





■ <i) 


. (2) ■ 


, " (3) , 


(4) 


(5) 


\ total 


3,016,526 


2,862,893 


"^-5.1*** 


4.2 


. < ■ 0'.%2 ■ 


total 


1,019, .685 


921,217 


_9.7*** 


5.3/ 


s 0.00 


total 


1,265,639 


. •^1^223,047 




■ 1.9 ' ' 


'• • 0/3 .; 


total 


45,149 


38,826 
• 


-14.0 ' 


I, J 




total 


357,950 


324 ,546 


-9*3** 


r 

3.2 




total 


72,833 


81,686 


12.2 

0 


2..0 




total 


- '24,790 


25,318 


2.1 




no/. ' 


total 


30,016 


28,235 


-5.9 


' ' 1 • ^ 




total 


163 ,581- 


132,905 




1 .o 


n A 7 
u . 0 / 


proportion 


.3422 


.3JW^ 


-3.9** 


' 2.5 


. 0.36 • 


proportion 


.4242 


.4343 . 


2.3* 


2.0 ' 


. 0.60 


'proportion 


.0152 


.0144 


-5.6 ■ 


,1.3 


0.87 


proportion 


.1202 


V • ^1161 


-3". 5 


1.6 ' 


o'.77' 


prpportion 


.0245 


.0295 


16.9*** 


\ 3.3 


0.12 


proportion 


\ 0084 


.0101 


16.8** 


\ 2.6 


0.32 


proportion 


.0103 


.0108 


4.6 ' 


\ 1.1 


0,91 


propiprtion 


'. .0549 


.0554 


-0.9 


\1.0 


0.94 



*^ *** Significant ^t the .10, .05, and ,01 percent levels, respectively, with two- 

sMed standard normal critical regions. \ • 

\ ' ... -.. 

a) Based on data from the NLS BY, FFU, and Recall-Error Surveys, 1972 and 1973. 

> • 

by Termed "test estim4te" for purposes of assessing the biasing effect of school non- 
response comparison in this study and does not actually comprise the^best estimate 
available; for example, it does not reflect adjustments for sampling frame incomplete- 
ness or weighting class adjustments that can be used to comp^ensate for student NR in 
cooperating schools. Also, category totals were not forced "to sum to what might be 
termed one of the more reliable estimators of number of seniors in all categories, . 
one based on student record information, • \ 



c) These BY estimates were calculated specifically for this study using BY methodology 
and data that were available at that time, but because of recent revisions to the 
number of seniors in some sampU schools, these BY estimates differ slightly from 
^previously published BY estimates. - ^ 
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9«7 percent for the number of students indicating "General" programs. For 
ratio estimates, three categories showed significant positive bias and one 
showed significant negative bias. One of the more noteworthy observations 
here iselates to the significance of bias in the ratio estimators. Three 
categories, for ratio estimators are significant at the .05 level or higher. 
These categories relate to the proportion estimated in i:he BY for "General" j 
school program, which is indicated to be negatively biased by 3.9 percent, • , / 
the proportion' in "Distributive education," which is positively biased by / 

^ .• . • ^ 

'16.9 piarcent, an<| the ^proportion in "Health" <^fth a positive bias of 16,8 
percent. One , might cbnjectur^' that the overrep'resented small schpols have 
proportionately more "Distributive and Health Education" students and' f^wer. 

"General Education" students as compared to^he larger schools, / 

* • ' ■* 

A measure of the importance of bias can be obtained by comparing it 
to sampling error. One such comparison, i4lSE/Sfe, is presented in table 
MSE becomes mcfte pertinent than the standard error when a significant bi^s 
influences 
equation; 



:es the accuracy of a statistic; M§fe can be repres^ntedfcby the following 



. MSE » SE^ ^ BIAS^ r* 

where' * • ^ 

MSE = mean square error and 

SE = sampling error .-^ . . ^ ^ 

When the ratio > i4lSE/SE, is near unity, the bias is relatively unimportant; 
and the standard deviation or sampling error (SE)' may be used to describe 
the accuracy of an estimate. Note that for the proportion estimatSes presented 

'^in table 3, only two, those for categories 7 and 8, may be satisfactorily 
described using SE (or coefficient of variation as was used to report BY 

, statistics). The proportion ^^sti'mates for categories 3 and '4 may also T^e * 
satisfactorily described by SE b-e cause the bias estimates, although larger, 
are^relatlvely imprecise\ Wben ^tihis ratio, AlSE/SE,'^ls less than approxi- 
mately 1.4, the MSE can be i^sed to relate estimation accuracy and can be * 
interpreted, without serious erro?:, as if it were the SE. In other words, 
with VmSE/SE ^.1.4, the confidence 'interval of ^ ✓kSE Z(l-a/2) can, in practice,' 
be interpreted in* the same .way as if the estimate were unbiased and + SE Z(l-a/2) 
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!^l-a/2) 



were»used to set . two, sided (l-a)-level cpnfidence intervals where Zi 

a- ' ' 

is the upper l-a/2 percentage point of the standard normal distril^ution 
13]. For larger values of this ratio, such as 'those indicated for^the proportion, 
estimates for "categories 1,-2, 4, 5, €^rid 6, the reliability of th^ estimate can 
be represented by the area of the ,st^ndard normal distribution between the^ 
values^ ■ ^ ^, . ■' " ' ' 

can be seen in the final column of table 3, accuracy of the proportion 
estimates with relatively large V^SE/SE ratio was seriously overstated by 
using only SE. For the proportion estimated for category 1, for example, 
the use of SE alone would result in the statement that the true proportion 
was within + 1.96 SE of the estimated proportion with, a confidence. level of 
.95 wWJ, in fact, this statement holds with a confidence level of only .36. 

BSYRQ5, the second question studied, reflects substantially the same 
severity of school NRbias. This question relates to high school ^grades -.^^ 

Which of the. following best describes^ your grades so far in high school? 

^ (Circle one*) 

Mostly A (a^numerical average of 90-100). 1 ' 

About half A and half B (85-89) 2 

Mostly B (80-84).^. .: . . .V. . . . 3 

About half B and half C (75-79) . ....... . \ .n. . 4 

Mostly C (70-74). . . . .... 5 

. About ^haif C and half D (65-69) .......... . ^ . *6 . 

Mostly 0^^0-64). .... ^ 1 

^ostly below'^ (below 60) . . '.^ ..... S 

The analysis of this questi^ suggests, as pointed up in table 4, ttiat tj;ie 

overrepfesentat4.on of 't!he relatively smaller schools, which was indksj^d 

to result from substitutdLon-^'and weight adjustment for school NR, preducad - 

a stibstantial downward bias in the estimated proportion of high school students 

receiving above average grades and an equally signi-fteant upward bias in 

proportion receiving low grades. For this quest:ion also, the final column 

of table 4 reveals that the accuracy of proportion estimates is substantially . 

overstated in all but two of the eight question-categories; ^ ^ ' 
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Table 4. Bias arid Reliability for BX, Estimates' 
Related to BSYRQS ^^' / 



Question, Type of . "Best BY 
category \ estimate estimate" estimate 



Relative 
bias in 
BY estimate, 
percent 



y kSE for 
SE 

BY ^estimate 



Confidence level 
. . for the ' • : 
' 9 +1.96 SE/ . 
, interval 



All 




(1) 


(2) 


(3) 


(4) 


X5) - 


categories tdtal 


3,016,526 


2,862,893 


-5.1*** . 


4.2 


TO. 02 


1 


"COuai 


286^803 


276,994 • 


-3.4* 




0.85 


<> 


total _ 


' " 597,034 • 


-532,879 ' 


^10.7***- ; 


4.5 


*. 0.01 






629,319 


. 569,670 


. -9.5*** . 


, -5.5 . 


0.00 


4 


total 


804,900 


781,085 


-3.0** 


.1. 9 ■; 


0".63 


5 


total 


423,608 


.399,017 , 


-5,8** - 


.2.5 


• 0.35 


o 


total 

•* 


206,052- 


189,534 


-8.0** 


2.4 . 


. ^ 0.42 


7 


total V 


26,046 


30,005 


15.2** 


' 2.1 


0.54 


8 


total 


5,910 


7,367 


^24.7 


1.7 » 


0.74 


i 


« 

proportion 


^.0966 


.0994. 


2.8 


1.3 


. 0.85 


2 


proportion 


.2002 


.1913 


-4,7** . 


2.6 


0.33 


3 


proportion 


.2108 


.2043 


-3.2** 


2.2 


0.50 


4 


proportion 


.2703.. 


.2807 y 


3.7** 


2.8 


0.26 


5 


proportion 


.1422 


o ' .1429 ? 


0.5; 


■ - 1.0 ' i 


0.94 


6 


proportion 


.0692 


.0679 


-1.9 


1.1 • 


0*91 


7 , 


proportion 


- .0088 


.0107 


17.8*** (J 


2.9 


0.23 


8 


proportion 


.,.<D022 


.0028 


21.4**** 


' 1.8" , 


0'.68 



? ■ 

*^ *** significant ap the .10, .05, and .^01 percentV levels, re«ectively, w^:th two-s)Lded 
standard normal critical- regions. " ' J . ' ' ^ '"J'-: i^^^^-^-^-^^ ' 

U) Based on data from the NLS BY, FFU, and Recall-EriiDr surveys, 1972 and 1973. 

(fa) Termed "best estimate" for purposes of assessing phe. biasing effect of scho<tl non- 
response Comparison in this study and does not actually comprise the best estimate 
available; for example, it does not reflect adjustments for sampling frame incomplete- 
ness or. weighting cl^ass adjustments that can be used to compensate for student NR in 
cooperating schools. .Also, category totals were ribt forced to sum to what might be 
termed one of the more reliable estimators of numb^r^^of seniors in all categories, 
one based on student record information. 



(c) ' These BY estimated were calculated specifically for this study using Bt methodology 
and data that xSrere available at that time, but because of recent revisions to the 
number of seniors in sonfe sample schools, these BY estimates differ slightly from 
previously published BY estimates,. 




, In-order to utilize a consistent set of data o*^ number ^£ seniors 
enrolled iit each school, the most recent and ^reportQdly most .accurate series 
was utilized. This resulted in estimated totaW being slightly lower than 
th osft ori g inally publis hed (approximately-^ percent), ^ut this differe4c» 
should* not have had any significant influence on estimated proportion^ 
. or .estimated biases for either totals or proportions-*. — JIhe appropriate^ 
*^ way to adjust BY estimates, if such adjustments are made on the basis of ' 
these bias estimates, is to adjust the published estimates of^' proportions 
as opposed to 'adjusting proportions estimated in this, study. To adjust 
for the indicated bias in the proportion estimated for categoryT! of BSYRQ2, 
for example, the -3.9 percent should be added to the published 32. 8T [4] 
rather' than to the 32.94 presented in table 3. The adjusted percentages 
could be calculated according to the following equation: 

» P - P(B)/(S + 1) . > 

where - . ' 

■ - -A ■ • ' . .. ■ 

P'. E the estimated percent of students responding to a particulaj^ 
' category adjusted for schocrl NR bias» ' : ^ 

P(B) E the corresponding biased BY estl^mate, and 

^0 = the estimated relative bias expressed $a a proportion of P. 

/ ; ■ ' ■ ■ 

In the example of category 1 of BSY^2,' the adjusted percentage would equal 
32. 9/ (-.0-39) + 1) or 34.21 This example reflects the fact that, where 
totals or proportions as previously published differ from those in the 
present study, the bias that, is attributable to school NR is more, reliably 
indicated by' the bias estimate (as in^ column 3) than by the difference 
between the published estimate and the "best estimate" calculated in this study. 
2* Conclusion ^ ^ 

This analysis of possible bias. in BY estimates, which relates to 35 
questions on the MLS Student Questionnaire, indicates that school non- 
response (NR) substantially affected many of the statistics developed from 
the BY survey. The NR effect, which will be termed NR bias, was identified 
by viewing the difference between BY estimates as they were calculated 
versus es,t^.mates that incorporate the additional information obtained during 
the First Fallow-Up survey of 1973. This difference necessarily relates 
almost exclusively to school NR bias because the difference between the 



ERIC 



o ^ 



two estimates' results solely from reducing the school NR from approximately • ^' 
20, percent to- a* minimal two percent. . * 

TJhe average NR. bias is "approximately a ne'^ative five percent for estimated 
totals, such as the estimated number of eligible seniors in 19^, or the 
estimated number of seniors who would respond, in a. particular question- 
category cn the MLS student questionnaire. This difference suggests that-, 
within a *maj or stratum, the larger schools declined to participate* more 
frequently than did the smaller schools. Note that irrespective of whether-' 
substitute ^schools or weight adjustments were used to account for school 
NR, the responses and characteriistics of one or jnore cooperating schools . 
within that major stratum were iised in place .of the NR schools. 
* The BY methodology also involved the substitution of positively responding 
schools for schools that had no eligible seniors, were closed, or did not 
exist — "valid zeros," Admitt^clly, such a substitution , is not appropriate 
for -the estimation of totals,' but the fef feet was apparently small~resuit:ing 
in approximately a one percent increase in estimated totals. Estimates 
of totals presented in this report reflect the zeroi as valid resptinses. 

Ratio statistics (proportions) have been usei thus far in priesenting 
the NSL ^findings, and, providing that student-response proportions are 
approximately the same for larger as opposed to smaller schools, the negative 
bias in totals would not be of particular concern. The analysis indicates, 
however, that the response proportions are not uniform by size of school, 
and that substantial bias from school NR is also reflected in the BY estimates 
of ratios or proportions. These\biases are alternately positive and negative 
for each question* because if one question-category is biased in one direction 
"then one or more of the remaining categories will reflject this bias in 
the opposite direction. Statistically ^significant bias was indicated for 
estimated proportions in 14 of the 35 questions studied. Approximately 
or;e- third of the questions had one or more categories that reflected 
proportion-estimate bias significant at the 5 percent level or higher. 

In view of these findings , several topics become pertinent fqr 'consideration. 
These include : , 

- Because of this bias, reliability statements for many of the BY ratio 
estimates were probably overstated - uset^ of BY statistics should 
be cognizant of this. 
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When compafing followiip statistics against the BY statistics, 
allowances should be made for the bias in those proportions ±n 
which bias was indicated. If patterns can be identified in the ' 
types of responses that are upward biased, downward biased, or 
not biased, rough approximations of bias might also be inferred 
(for selected questions that were not Investigated in this study, 
(This possibility and the extent to which this bias is accounted 
for by the class-adjusted weights on the Public Use Data File 
[ref, 1], however, have not been dealt with here./ 

- Initially, RTI proposed to Investigate the individual effectiveness 
of several techniques that might be used to deal with the prt)1>JLem 
of school NR. The computer software for this additional work 
has largely been developed, but has not yet been^utilized. In 
view the Implications of the findings thus far, however, it 
now seems that this additional analysis may be instructive, 
whereas, if no significant bias had f)een found in the BY ratios, 

^ the additional analysis would h^ve been somewhat academic. 

- When class comparisons (age-sex specific/ for example) are con- 
templated, valid interpretation of ob|5erved differences may be 
precluded by biases of the magnitude Indicated unless these 
biases are accounted for. Therefore, although biases at the 
subclass level were not estimated in this investigation, their 
usefulness should also be considered. ^ 

- The study findings clearly demonstrate that the use of backup 

schools (and probably backup students) cannot be relied upon to 

produce unbiased estimates. Hence, in future surveys,, greater 

it 

emphases might advisably be placed, on obtaining higher response 
rates from the initial sample, with less or no. reliance being 
placed oti usf of the backups. ' % ■ 
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C. METHODOLOGY 



^ In this se^ction, the methodology Is presented that was used to obtain. 

' the estimates reported In Section D, below, and in the NLS final report. . 
The two methodologies developed^ (see the appendix also^ In ^he study 

IP^voke simplifying although dlff^ent assumptions, and both rely on. Taylor 
linearizations of nonlinear statis^t^lcs as a basis for estimating variance: 
It was no't ascertained which of, the ''^q methodologies is superior, so that 
it Should be noted that the methodoloj|^ described in^ this section was used 
primarily because it involved somewhat %ss software development. ^ 
1 . Overview %./ ' 

In previous papers on NI^ methodology 2] for example, the estimation 
of bias was proposed using equations of the fonn: ) 

0 » X(B) - X : . ^ , (1.1) 

where ■ ' ^ ^ . 

B 5 thfe estimated bias of BY totals that resulted from school 
• nonresponse; ^ ^ . 

X(B) = the BY total, biaged by School nonresponse, and is a . 
. .weighted sum of the following type 



X(B) -EE I 



600 


% ■ 


^1 


Z 

h=l- 


Z 
1=1 




600 


% 




Z 


z 


^1 


h=Fl 


1=1 


600 






Z 




and 
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C^-i ■ ^- , 

X = the BY total correcti^d' for school-nonresponse bias based on 
a follow-up of iioncooperating primary schools; and subscripts 
h, 1, and j relate to stratum, school, and student, respectively. 

X(B) and X are two estimates of, totals, sucj>/as, the number j?f seniors that 

would indicate a specific question-category on the Student Questionnaire. 

^ These two estimates differ only in the values of weights, W^j^ j ' values 

of student response^, "^^y for those ^mary schools that did not participate 



v.. 

In the ST survey. In this analysis, two .(nij^='2) 'scHoo3j' observations are used 
in each estimation model from each of the 600 final strata, with n^^^ student^ 
observations per sample school. The wei'^hts, W^^^^ ''•^hij ^\i^^i^' 
st;udent weights adjusted for 'nonresponsje within -part iciipating schools by 
letting^n^^^ depict the count of respon/ing seniors in place of the number 
selected. The Xj^^^ are taken to W 1 or 0, depending upon whether- 

► a responste category is selected' or not selected by student hij . ' 

Notice that W, /\» W,^ 'is constant for each of the j=l (1) n students. 
iy.j\ hi ^ hi 



Also, W in the calculation of X is the original BY unadjusted school 
' • . uhi ^ , 

weight for primary school hi. 

As demonstrated in Section 2, below, eg uat ion 1.1, which appropriately 
expresses- the bias as a difference betwee^^two interdependent%stimktors , 
can be s^.mplified. That is, the 3 of equation 1.1 can be recast as a 
weighted sum of the type used' to estimate X and X(B), thus facilitating 
the use of the same estimation and variance equations as those already 
being used in NLS analyses." Otherwise stated, X(B)j^^, the "half-sfcratum" " , 
total based on school hi, is calculated £pr each primary school according 
to whether the school responded in the BY; was substituted for^in. the BY; 
or waS" estimated in the BY on the basis of responses from similar schools 
(weight adjustments). The difference between X(6).^^ and the , which 
is corrected by resurvey information, comprises ^ the biafS indication for 
primary schiol hi expanded up to reipresenrt a "half stratum" bias for ^ 

school' nonresponse in#:hat. stratum. In this difference, or 3^^^ form, the 

■ # 

3. have straigh^orward variance estimate^. - 

Thus ,* the bi"as for school nonfesponse is reduced to the linear statistic 

/ 

3 - X(B) -yX 

600 2 . ' 

. = L 1 B^,^ ^ ' i . (1.2) 

h=il i=l ^ 

with estimated variance 

60p . . 2 

V(3) - E [B^, - 3^2^ • 

h=l ; > 

Variances for ratio statistics and their biases are approximated using, 
Taylor linearizations. The details of these^inearizations are presented, ? 
'below, in Section 5. 



2., Assumptions * ^ 

In each stratum, two "difference" or "bias" values are observed, one 
for each primary-sample school. These values are the differencea between 
student 'information late?? obtaiij^ed for. that school and the information 
actually used in the 1972 BY estimates ; 'of ten these two values are identi- ' 
cai resulting .in a "difference" or, "bias" value of zgro. Each of these 
"bias" indications taken ^to be an independent observation from the popu- 
lation' of schools in that particular stratum (an observation, that. presumably . 
reflects the propensity to cooperate atxd related factors for ' the schools " t - 
in that stratum)^ In fact, however, each of the observations is not pre- 
cisely an ^independent observation because its value will' depend upon which 
school was selected as the other sampl? school tor the stratum, which J$ample , 
schools fw'ere selected, as substitute schools, and vitiich schools were selected^ 
in other final strata in the particular major strata, a^ well as the willing- 
ness of each of these schools to participate and their characteristics. 

' By taking the expected value of g in equation 1.1, and' noting that 
X is a relatively unbiased (in terms of'schoOl nonresponse bias) estimate of 
X for a specific quiest ion-category, one may note that B is, by definitipn, 
an unbiased estimate of the bias in X(B)v Variances of 6, however, may be 
slightly understated by this methodology because the covariailce terms, 

cov[ei.i, 3uo]> which are assumed to be zero in the calculation of stratum 

hi h2 ^; 
variances, are suspected to have small positive values.- Ttje B, V l^iian titles 

alluded to are the' expanded^up bias-measure f<>r schools i = 1 ana '2 presented, 
in the previous section. 

3. Resurvey Results and Their Use in This Analysis 

As noted in Section A, above, a FFi; subsampLe of 500 students was asked \- 
to. recall their answers to selected questions 'that had bte^n asked on the BY 

Student' Questionnaire-? This information was used in t^ie present investi-^ 

/ ■ 

gation to account for possible \memory bias in BY information collected 
retrospectively in the FFU survey and, hence, in the calculation of X in 
equation 1.1. The. selected BY student data that were obtained retros/^ectively 
in the 1^73 FFU survey involved a sample of 1972 seniors of the primary- 
sample schools . that did not participate in the BY survey. Because this 
information about school ,NR bias was obtained retrospectively, it is 
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on the BY Student Questionnaire. The- questions, numbers 78 and 86-99 on 

the FTU Form B, actually involve a' total of 35 questions (some are multiple- 

%■ 

part questions) . 

For -each of the 35 questions, a k x k matrix of n^^ valued were ealculated, 

where ^ 

k-1 = the number of alternative responses allowed for a particular 
question (row k and column k present frequencies of improper / 
* .' responses, such as, refusals, multiple responses, out-of-range 

• responses, and "other". or "Don't know" when these are not explicit 
■ , , options)^ and . 

p. the number of sample \students giving response f in the TFU survey 
^8 ^jjj response g- in the BY survey . 

Several stattstiGal tests were maiie on each question to ascertain its reliative 
staibility (amount of retail bias). One of these tests-, for example, indicated 
that one-h'alf (l7) of the* questions can be reported "with 80 percent consistency, 
that is about 80 percent ojf the students would ^nter^ the same answer in 1973 
as they did in 1972. The statistical test, which is relied upon for th'is 
analysis (M bias), views the marginal .totals, (n ^ and n^ ) of these ma^^gs 
as being (k-l) dimensional multinomial varlates with vector parameters o^^ 
ir * and IT-, respectively. The hypotheses that were tested include: 

" H : ir,,. ^4 TT„ for at ll^^t one f (f » g = 1, k-1). 

a . ,J.f , 2g . . . • - . 

Because, in- the present methodology, the unacceptable responses are dis- 
tributed propprtionately, this category is not of particular interest in 
adjustine^pr M bias. The test of homogeneity that excluded the proportion 
df unacceptable responses, therefore,' was used in this analysis as the test, 
criteria and indicated-" that the following 16 questions .contained significant 
recall- bias : , ' . ""^ \ " \ <: • 

' 78 A, B ' . . 92 A, B ^ : , 

• 81/ 93 

88 , ' — 94 A, H, J_ 

89 .A, H . ■ 96 , • ' ' 
. ' • * 90 97 . 



question and category, say category g, we hav^.: 



^ghi - ^ghi Vl 



^uf^ V. Z'U ....'k-1 , (3.1), 



where 



X , = the "best estimatte" for the category" g of a particular 



question for school hi, 

X^^IP^ = the First Follow-Up response, X^FT\ corrected for memory 
^ or recall bias (see l?elox/) , and^ 

' . ' Ri-^/^ a factor that distributes "or "smears" the unacceptable 

.' "7 answers over the remaining k-1 categories for that question 
. (see jjelow) . 



where the X^^ aire as defined for, 3.1, atid . / 

ghi - ^ 

n .= the number of students (of the the 5()0) tliat reported 

.category f in the FFU and category g Wthe BY survey, and 



"f. ^ "fg V 



^ "(FF) *(AFF)'- 
Finally. R^^ - I X^^l ^ " ■ '. 

■*Responses to the remaining i9 questions were used without adjustment for recall 
bias; that, is, • * >^ 



0 



FRir - 



.ghi 



for all k-1 categories. The unacceptable responses;^ were *'^ae^^(i". for all 
questions. 

4. Estimation of Bias- In BY Statistics; Totals . ^ 

The methodology developed here gains some of its appeal from the fact 
tliat the statistic B is an unbiased estimator of the bias in X(B); that is. 



E(8)' 



E[X(B) - X] 



E[X(B)] -.E[X] 



o X + BIAS;^^3j - X 
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and can be reduced to 
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Proof: • 

Frpm 1.1 we have: 
^ '3 - X(B) - X 



or 
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respectively. * 
Continuing with the proof, _ 

. • ^ 600 2 
h«l i-l 



600 7 . * : • \ 

I I A. as was to be shown* 

h-i ^i-i 



where 



X(B) , = either an expanded re^ponse„for a substitute school, the 
estimated value of the companion school (primary pr sub-' 
stitutiB) in that final stratum, or an average estimated 
value for the major stratum & 'that contains stratum h, 

X. .= ' a "best estimate" for primary school hi ^(expiijed toithe ' 
.. ' half-stratum level), * 

; W' ' = . the student weight, adjusted for student nonresponse, for . 
the primary school, or 

,. " t 



with 



■ =. the^number of senior students in primary school hi, 
hi • 

n/ = the number of sample seniors that finally responded on the 

• ■ Student Questionnaire . either in BY or FFU, 



1 for all primary schools in the large-school (300+) strata; 



Presurvey estimate of senipr enrollment-»for primary schools in 
the small-school (<300) strata. ' v 



a! s . I AJ^ = total measure for- all schools in stratum h in the 
. • i»l ^\ entire .sampling frame. ^. J - * 

The biased estimatl,, Xj^^(B) , takes -BeVeral forms' depending on the BY respons| 

experience dn stratum h. . Consider the following- pos^bilities: 



a substitute response was., used in its -stead, then 

■ .««hl -'^s' "h6\s . , « ' . .. 

. / where the subscript s denotes a substitute school and 



.1 - 



iS 



with 



l' if student j in the substitute school indicated 
particular question-cfitegor^,. ^ 

o"li,therwise ' 



and 



^i - '^s - ^i 



(3) Primary school hi declined to participate inv the BY survey and only 
•■ one school in/seratum h, participated, this school being either the 
companion primary or a substitute for the comp&iion primary. The 
weight of the cooperating school is doubled to account for ?this 
nonnefeponse. Thus, ' , 



Xj^^, if primary s^^ool hi' participated; 



\ 



Xj^^/ ff a'.substitutfe school s participated; 
and correspondingly, 



n 



hi 



or 



(4.3) 



(4) Primary school hi in major stratum I along with its con^anion pri- 
mary and both substitutes in stratum h declined to participate. 
Then the weights of all participating schools in stratum I are 



' inflated by the factors C^^^j 
where: 

v;. ■ C 



ih 



(4.4) 
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Hj = the number of final strata in I with at least one .' 5 
participating school. * ' 

'Adjusting weights of all BY^articipajihg - schools in major strattlm I 
by the smearing factor C^^^ is equivalent to substituting for each 
primary school in a noncooperating stratum ih -the contribution 

^^hi ■ *hV2 . ' ^ ■ ... . ■ 

i»l i»l 

and -A^^ » th^ presurvey size measure for school hi, 



' where. - ^^^^^^ 



Z" ^5 summation overfall final .stratum h in major stratum i^, 

heBY(Jl) that have at least one (iftj^"!) participating school; f^^ 

' - ■ . ' ' ''^ .- > ■ ' * : 

Xj^^ = the school level estiinate, Nj^^ X^"^/t^^ 

W ^ . = the adjusted school weight; that is 
ahi 



Thus, e. . ' ti^ - i^^ and we notice that £0.r small- , (4.5) 
enrollment schools is a proportion and for latge-enrollment schools 
is a school average. This .result can be verified by noting that 

X(B).-X' Z t W* X^. • , - 



-I z w' , x;, 

heBY(Jl) i-l - ^^^'^^ 



I E W' x;. ., ' ■ (4.6) 

• h^BYCil) i-1 



hm{l) i-l iieBYOl) ' i-1 ^^^^ ^ 
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E 

[IVBY()1) 1-1 



uhl "hi 



heBY(Jl) i-1 ^ 



■ • ■ . \: 2 . 

* E E W . .Jx, . + E E W ' A, . X ' (4.7) 

heBY()l) i-l ^^^^^ h({BY()l) 1-1 "^^^i^ ^ , 

so, for strata WpY()l), from A. 6 and 4,7,\- 

■ . ■■ . • 2- /■• : . ■■/■.■„ , V ■• ■■■ 
x(B) -x- E .e;.w (A^x^A-x; )... 

hsfBYOl) 1-1 - Til i M 
ThuS', f or ^ach school in hgi' BY (£)■ . ► * ^ 

as was to be shown • 

The variance for 0 Can be estimated o| the. basis of the var^lation of * 

these 3, . values, two in each stratum. As noted earlier, this, assumes that 

■ . * ni ,^ ■ ■ ^ ■ ■ 

each . la an Independent observation from stratum hi, an assumption that m£^y 
hi A 

cause var(-6) to be slightly understated. Also, note that the clusters of 

■■...»■■" • , 

final stage sampling units (students) in this characterization are not d^fined^ 

In advapce and become clustered or associated with one another through Sv^pom- 

plex conditional selection process that depends on which schools are selected 

for substitutes and whether they cooperate when needed. Irrespective of ' ; 

the complexities of this clustering process, cluster totals will contain con- 

tributlons from both the "between" and "within" cluster variation j and can 

be used to approximate this pertinent variances. 

The following equations are proposed for the estimation ofjthe variance 

v;r<5) m^s^ + r:^s2.. ; ^ ■.(4.8)- 

■ heR hg^R . • , 



schools on the basis of resurvey efforts.- For tpese 26, data from other 
schools with comparable nonresponse patterns were used to' estimate ^^^^ • 
the second term of 4.8, above. - ' ' , 

^ - [0^^ - 0^2^^/^ when mj^ - 2 . ' • • 

.5. Est imation of Bias in BY Statistics: Pr-opoitions ^ 

For each qu$sj;ion-category that was treate;d irv the resurvey, the bias B- . 
was estimated for the BY proportions or averages. These ^timatprs, X, are 
the ratio estimates because the population and subpopulation tcftals of *the 
denominator are not generally known. ISe numbers of senior students for most 
school^ are known, app-roximately , but in general the numbers 'Of students in sub- 
gr^upslmust be estimated. The bias for these ratio statistics can be estimated 
according /W^the equations in Section 4 above, for the numerator and denominator 
individlSlly, ijut the bias , of the ratio is not the ratio of tifcrbiases, . 

rather: . - , 



X(B) _ X 
N(B) 



X + 0 X 
X 

A A , At 
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(5.L) 



Equation 5.1 can be quantif led .b^ simply substituting the prior estimates^ * 
of totals. The variance of, this composite' statistic cahnot be calculated 
as before (Section 4), but is approlcimated by E d, where d^ is derived below 
using a 'Jaylor linearization: 



where 



r 



X and X(B) a<re according to equations' defined in Section 4, 



N(B) 

A t 

6 and t 



N 



h and 1 = 



the summation of X(6) for all categories In a particular question 
or an estimate of the total number of seniors/ 

bias estimates developed In the previous sec^tipn with the . 
subscripts denoting estimated category total ^nd estimated 
number of seniors, respectively, and — 

subscripts designating strata 1 to 600 and schools 1 and 2 
within each stratum. 



The following are partial derivatives with respect to each sample dpaw 
varlate, leyalfiiated at expected values. 
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N ) . . . ^ 

■ ^ % referred to, above. 

.h 

b. Other Techniques of Accounting For School NR 

The mfethodology used to investigate school NR bias in the BY .estimates is 
extended here to address other selected techniques of accounting for school 
NR. These techniques are na-oed 1) unlimited substitution, 2) subgroup 
weight adjustments, and 3) aggregate adjustment. The computer software for 
these investigations, which correspond to topics suggested by Motre [2], 
was only partially completed in the present ef fort» ' 

a* Unlimited Substitution .; 

An indication is sought here of the bias that would result from 
unlimited u^fcf substitute schools withiii each final strati4m;>, that is^ the' 
number of contacts would not be limited to four schools as they were in the 
BY survey. The following bias estimator is proposed to evaluate an estimated 
total for a particulat question-category. 



The (hi)' subscript pertains to the use of the previous indication of 
substitution bias for those primary schools that were imputed in the 
BY by adjusting weights and, hence, do not constitute, a valid indication 
of substitution bias; 

3^- H the estimated bias for the statistic, X(l), being investigated 
In this section; ^ 



C X(l)j^j^ = the biased estimator using subatltutlon only for stratum h and 
'primary school 1 (sea (4.2); £nd • 

Xj^^ = the "best ..estimate" for school hi (see 3.1). . 



Variance of 3i Is according to 4.8 except for the summation ranges: 

2 « 

^ IeBY 1=1 ^'^^ 

2 « * 

+ E E (B;:,,v» - Bi/uom)^" (6.2) 



WBY ^1 ■ 1(^2) 



where tes&s are defined as in 6.I. 

b/ Subgroup Weight Adjustments' 

. Here, the methodology is presented to investigate the amount of 
bias that might result with no school substitution, but, rather, from using 
weight adjustments at the lowest possible level, mp method of accounting 
for school NR suggests that nonrespondents in a final stratum h (or major 
stratum i) are more characteristic of respondents in that stratum than 
respondents from some other stratum* The following bias estimator is pro- 
posed for evaluating school NR bias in estimated tota^% using these weighting 
techniques. ', , . 



ine range oi rsummacion reiac^s co aii primary scnoois excepc zne 
that have declined to participate In both BY and FFU surveys; 

The (hi)' subscript pertains to^ the use of the previous Indication of - 
weight-adjustment bias for the 26 noncooperatlng schools alluded to above; 

^ . ■ . .. - 
i^^ z the "beat estlinate" for school hi (see (3*1); 

^2 ' = the estimated bias for the statistic being Investigated in this 
section; and . 



X(2) 



hi 



Xj^^ if the primary participated in the BY 
According to equations 4.3 or 4.3 otherwise. 



Variance of 62 according to 6.2 except the summation ranges a^e' changed tc 

correspond to ^2* " ■, ' 

c. Aggregate Adjustment ) , 

Here, a methodology is presented to evaluate bias tMpt C^n be expected 

to result with a "minimum treatment" of JIR,. the use only o^k single, aggregate 

adjustments The following bias estimator, 3*,^ relates to a pa^rtlcular 

question-category and to an estimated total. 



where ' ' 

ilheTange of summation and the (hi)' subscript are as defined for 6.3; 

A , A 

0^ - the -estimated bias for the statistic, X(3),, being investigated 
in this section; and > i 

^ = estimate" for school hi (see 3.1).. ' 



The autnmatlo^ range, BY, pertains to all primaries responding In the 
by; N, . Is the recorded number of seniors In school hi; and the 
variance of 0*^ ,1s according to 6*2 except the sommatlon ttoges are changed 
to coincide with 0^* 
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35 queatlorta, and the propprtiona of seniors that would respond In feach 
of these categories. The methodology Used to estimate the biases of these 
BY atati'stics Is presented In Section C above. For proportion statistics, 
this bias, or ndt Influence of accounting f or nonrespondlng schobli^^, relates, 
to statistics as they Were calculated In the base year; note, howevier, 
'that the statistics were actually recalculated for use In this analysis, 
,^80 that 6ny alterations In base year weights' or clata tapes would have -minimal 
effect on the estimation of bias (steps werfe taken throughout to ensure 
that the bias estimates would, as nearly as possible, relate solely to • 
school nontesponae) . ' a. - ' 

' The bias for totals, on the other hand, relates to •statistics that ^ 

are based on the BY methodology, only as it related to school subs titution^ 
and weight adjustment. Only proportions were presented in the summary 
Statistics of the NLS BY reports, so that the' pertinent fprm of a statisti-c 
fot totals was necessarily somewhat arbitrary. The results should, however^ 
■provide a useful indication of bias that might occur in totals when using 
techniques such as those used in the BY to account, for school nonresponse. 
Irrespective tof the exact estiitatior form. The statistic used to estimate 
totals in the following results is the usual summation of "expendedr-up" 
responses that Is used to obtain thg numerator and denominator values of • 
the NLS protiortlon statistics; except, "zero schools" are inclucled as velid 
responses. In the BY methodology, these "zero schools^wfexe substituted ; • 
for. A "zero school" is. one that had no eligible 197^' seniors , was closed, 

, ' ..... * , » 

or did not exist at the time of ,the BY survey.. 



Question: 



A, 



B5YRQ2. 'Which of 
school prograi^? 



the following best describes your present high 



Response Category > 



neral 
Acaaemlc ^ 
Agricultural 



Business 



Dli3tributlve 
Education 

Health 



Qome ' 
Economics 



Trade 



■■■ w . 


• w 

Seletted StatLstics- ' 




Estimated total 
for seniors in 
.each category 1 

thousands ^ . 


Bias in 
estimated 
total, 

♦"hotiisiinHQ 


Estimated pro- 
p'ottipn of s4iil6rs 
in each category, 


Bias in^ 
^ estloiated 

proportions, 
nercentase 
points 


.921 


■ -98***. 


*32.94 . 


0 

. -1.28** 


.• * (i9) . 


, (21) ■ 


. ;^(0.55) 


. (0.51)^ 


■ ' .,1 1,223 


-43** 


43V43 


■ i.di*. 


(26; 


(19) 


(0.59) ^ 


(0.56) 




-6 . 


1.44 ■. 


-0.08! * 


(6) 


• (0.10 . , 


(0.15) 


1 . 325 * 


-33** 


.11.61 


-0.41 


(11) . 


(16) - 


(0.34) , V 


('0.52) 


! , . 82/ 


• 9 


2.95 


0.50*** , 


. (5) 


(6) 


; (0.16) ■ 


(0.16) - 


25 
(2) 


1 

(3) 


IsW. 
■ ;(0.07)' 


. 0.17** 
> (0.08) . 


■ 28 


■ -2 . 


1.08 


0.05 


(3V ' 


. (4) 


(0.09) 


(0.09) 


' 153 


• - -11 


5.54 


0.05 ' 


- (7). 


' (8) 


• (0.23) 


(0.24) 



a/ 



b/ 



B^sed on data from the NLS Base Year and First Follov^Up surveys, and the methodology 
of Section Proportions are based on Base Year methodology throughout, but a modi- 
fication in the handling of "zero'^ schools was Incorporated to estimate totals (columns 
qne and -£Vo), hende the estimated proportions do not ^coincide exactly to the estimated 
totals. ; ' ' 

i ■ - ' . ' 

Standard deviations are presented in parentheses and *, **, *** 'indicate statistical 
significance of the bias estimates at the O.lO, 0.0!^, 0.01 a-error levels, respectively; 



Question: -NjSYRQS. Which of the following best describes your grades 
> ^ high school? ^ 



so 



'4 



Response Category 



Uostly A 

• ^' •'■ 
Half A^and' 
half^ 

Mostly B 



Hal£;B and 
half C 

Mostly C 



Half C and 
half D 

Mostly D 
Mostly bddw* D 
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. Estimated total 
for seniors . in 
each category,' 

thousands 


Bias In 
estimated 
total, . 

thousands 


Estimated pro- 
portion df. seniors 
^ in eachiCategpry , 

■ t 

percent 


Bias In 
estimated 

proportions, 
percentage 

PC/XIlLS 


277 


-10* *' 


■ * . ■ 
9.94 : . 


0.28 


:^ (11) 




« (0.31) 


(0.24) • 


533 


-64**** 


19.13 


-0.89** 


.*. (15) 


(15) . 


■ (0.37) 


(0.37) 


• "570 


-60*** 


y '20.43 


-0.65* 


(11) • 


(14) 


• (0.33) • . 


(0.36)^- 


781 


-24**.' 


- 28.07 


i.04** . 


' (15) 


(12) 


(0.40) 


^ (0.43), 


399 


-25** 


14.29 


0.07 


ai) 


(12) 


(0.31) 


- (0.26) - ^ 


190 


-17** 


6'. 79 


' -0.13' . 


< - (8) 


(7) 


# '(0.23^ 


(0.17) ' . 


: ' 30 , , 


'4** 


1,07 


0.19*** 




' - <2) . 


(0.07) 


(0.04) . 




1 


' 0.28 • . 


0.06***' 


(1) , 


(2) 


(0.04) • 


(0.02) 



Based on/ data from the .NLS Base Year and First Follow-Up surveys, and the methodology ^ 
of Section' C. Proportions are based on Base Year methodology throughout, but a modi- 
fication in, the handliqg of "zero" schools was incorporated to estimate totals (columns. 
one and tw<^ , hence the estimated proportions do not coincide ^jcactly to the estimated 
■ totals.' ' ' ' ■ . ■ ' , ■ ' 

^' Standard deviations are presente^d in parentheses and *** ind^ate statistical 

significance of. the bias, esti^^^ 0.01 a-erroraevels, respectively. 



Question: 
Response Category 



None 

_ « 

Less than 6 
6 to 10 

ii to lA 

l6 to 20 
21 ttf 25 

: \ 

26 to 30 i 
More t^an 30 



•BSYRQ8. On the average over the school year, how manj^otirs per 

week do you work in a paid or unpaid job? (Exclude VaiSa^ions.) ^ ' 

■ u '* :• ' . ■ ' ;■*■'. 1^ . " ■ 

Selected Statistics-^ ' ^ 



Estimated total 
for seniots In 
each category, 

thousands 

^ 674 ' 
(13) 

320 
(8) 

342 

^ CIO) 

. 274 
^ (7) 



^1 



UO) 

286 
(8) 

196 
(6) 

306 
(8) 



Bias in 
estimated 
total, 

thousands 

-50.*** 
(10) 

-24*** ^ 

-V (8)^ 

-30** 
~(U) ^ 

-20** . 

(8) 

-^21*. 
(11) 

-22*** 

-11*** 

(4) 

-21*** ' 

. (8) 



Estimated pro- , 
portion of seniors 
in each category, 

percent ^ 

■ ' 24.31 5 . 
(0.37)'"; , 

11.51* ✓ 
- (0.24) : 

\ ii.3o 

:;;,,c,-'.(0.26)r' '. .■ 
9.82 

(0.22) ; :> 

. . 13.'67-:;> . 

/0.26). - . 

10.25 

' / (0.23) ^ 

^ 7.10 ■ ' . 
; (0.18) 

,11.0.4 . • 

,(o.26> ' 



■ fiias ;ih 
estimated, 
proportions, 
Ipercentage 
points 

• .-0.04- 
(0.42) 

-0.04 

(0;24>:' 

. '.-0.19 .: 
CO. 31) • 

-0.03 . 
.CO. 25) 

* 0.18 ; ' 

C0.Z8) _ 

-0.08 
(0.20) 

^0.11 

' (oa3) 
o.or 

(0.19) 



Based oh data from the NLS Base Year and. First. F(^Uow^^ surveys, and the methodology 
". of Section C . Proportions are based on fl^ise Year methodology throughout, but a modi- 
. iEication in the handling of "zero" schools \fHs incorporated to estimate tptals (columns • 
. one and two), hence the estimated proportions do not coincide: exactly to tRe estimated 
' ■■■ totals. ■ ■ , ■ ^ 

Vtandard deviations are presented in parentheses and *, **, *** .indicate statistical . • 
significance of the bias estimates at the 0.10, 0.05, 0.01 a-error leyels, respectively. 



Question: 



Response Category 



Hlave not. 
participated;: 

Have' partlcd 
^t^vely 

Have participated 
as a leader or 
officer 



vBSYRQlOA. Have ^ou participated Ih athletic teams, intramurals, 
letterman's- club- or sports, club, ^elther In or out of ^chool this 

■ yfeir? : ... . , ■ • ■ 





^Selected Statlstlcs^^ 




Est:lmated COtal 
for seniors in 
each category, 

thousands 


Bias In 
. estimated 
total, 

* ■ 

tnousancs 


Estimated pjro- • ' 
portion of seniors 
in each category, 


; Bias , In 
^estlUted 
/ propprtlons , 
• percentage 
points 


■ (25) > 


(26) j( . 


^ ... . , 

■., 56.13 

, ;*(o.si) 


. 0.40 
(0.73) 


(1?) 


; <27) 


; ;(o.43) 


U. Hi 

(0.59)'^ 


.27.5 ' 
(8) 


-19*** 
(6) 


9".92 . 
(0.24) ' 


0.01 
(0.24) 



'Talkie 9. 



Question: 



;HaVe?not; 
participated . 

Have, p^tlclpated 
actively 

Have^ participated 
as a leader or 
officer . 



- i.. 



• . * - 

B6YRQ10B. Have you participated in .cheerleaders, pe'p club 
majorettes, eith^S In or out of schoolvthls year? ' 



or 



2,298 
(30) > 

. ' 373 ' 
(17^ 

U2 

(5;) 



-133*** 
(37) . 

-53*** 
(16) 

. -8 
(6)' 



82r49 
(0. 55) 

13.47 
'(0.45) 

4.04 
(0.16) 



0.86 

(0i86) 

-0.89** 

(0.41)' 

0.02 

(0.16>: 



^' Based on data from the NLS Base Year and First Follow-Up surveys, and the methodology 
■ of Section C. Proportions are based on Base Year methodology throughout, but a modi- 
fication in the handling of ''zero" , schools was incorporated to estlmijte totals (golumns 
one ahd two), hence, the estimated proportions do not coincide exactly to the estimated 

dotais. • " , ." ■. '• '. j ;■ , , ■ 

Standard deviatiops are presented in parentheses and *, **, *** indicate statistical 
' significance of thfe bias estimaties at the 0.10, 0.05, 0.01 a-error levels, respectively. 
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Response Category 



b/ 



Selected Statistics— 





Estim^ed total 
for seniors in 
each category,. 

thousands 


Bias in 
estimated 
' total, 

thousands 


Estimated 'pro- 
portion of seniors 
in each category, 

percent 


" Bias in 
estimated 
proportions, 
percentage 
points 


HaveJiot, . 
participated ■„ ; ■ 


1,852 
' (28) 


-151*** 
(37) 


66.49 ' 
(0.50) \ ■ 


-0.64 
= (0.78) 


Have participated 738 / 
actively , ^^^^ 
Have participated ? , , ' 
as a leader or (7) 
officer .. ^ ' 


-46*** 

(16) 

-2 

(5) 

■ ^ / 

^ i . : 


• 26.59 ■' - 
(0.40) 

- • 6.92- ' 
(0.21) 


0.22 
(0.44) 

, 0.39*'' ■ 
"^<0.21) ' 


c 

Table 11. 


1 

i .' ' ' ■ 








QiiestiQa; . 


BSYRQIOD^ Have you participated in hobby dlubs such as 
model building, hot rod, electronics and crafts, either 
school this ye'ir? ' ^ 


photography, 
m or out or 

y. ■.; ■ ■■ 


Have not 
participated 


2,256 
(32) 


(45) 


81.13 


-0.35 
' (0.98) • 


Have participated . 
actively ' / 


.A60 
(12)^ 


-20 V 
(13) 


16.36' 
(0.33) 


0.28 
• (0.32) 


Have participated 
a^ a leader or ' 


70 
(4) 


' ! -3 
(5) 


2.51 
. (0.13) 


' 0.05 
- (0.12) 



officer 



^ Based on data from the NLS Base Year and First Follow-Up surveys, and the methodology 
of Section C. PropoAlons are based on Base Year methodology throughout, but a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals (columns 
one and twQ^, hence the estimated proportions do not coinclde^xactly to the estimated 
totals. ■' ^ \ 

■ ■ . .. y ■ . ■ ■ 

hi * ^ - ' ■ ■ 

— Standard deviations are presented, in parentheses ^ and *, **, *** indicate' ^statistical 

sighlficance^of t;h'e bias estimates at the 0*10, 0.05, .0.01 a-error levels^, respectively. 

. • . \ •■ * • I.' ■ • ' • 

' • ■ ■' . ' ■ 'I 

' < ... 
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Question: BSYRQIOE. Have youjarticlpated ' in honarary clubs such as 
or National Honor Society, either .in or out of school this 



Beta Club 
year? 



Response Category 



? 'b/ 

Selected; Statistics- 



Have not 

participated ',• . 

Have participated 
actively 

H^Ve participated 
as: a leader or 
officer 



Estimated total 
for seniors in 
each category, ; 

tho usands 

— I , _ ' 

'2,347 
(33) ; 

* 363 
.(13) 

78 . 
(5) 



.Bias in 
estimated 
total, 

tfeusands 
-l67*** 

,;^(4t 

' -21* 

' ' -4 
(6) • 



Estiiaated PtQf -;;:^ 
portion of seniors 

in each category, 
percent 

84.18 

: , (0^53) . , : 

12.-96- 
(0.38) ■ 

2..86 
. (0.16) 



Bias in' 
estimated 
proportions, 
percei^tage 

points 

•^0.14 ].. 
(0.90) 

0.06 
(0.31) ^ 

0.06 

(0..15) . 



Talile 13. 



Question: BSYRQIOF. HayS you participated in school newspaper, magazine, 
yearbook or annual, either in or oat of school this year-? 



Have hot 
participated • 


2,186 
(31) 


_153*'** 
(41) 


78.64 
(0.60) 


Have participated 
actively 


438 
(15) 


-36*** 
(12)' • 


15.70 
' (0.41) 


Have participated 
as a leader or 


'155 
(8) 


•■■V-12*- 
(7) 


5.66 
(0.25) 



9ff!tser 



0il7 
(0.55) 

-0.22 
(€.37) 

6.03 
(0.18) 



■a/ 



Based on data from the NLS Base Year. and First Follow-Up survey^; and the, methodology 
of Section C. Proportions are b^sed on Base Year methodology throughout, but a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals (columns 
one and two), hence the estimated proportions do not coincide exactly to the estimated 
totals. 



- Standard deviations arc presented in parentheses and *, **, *** indicate statistical 
"significance df the bias estimates at the 0.10, 0.05, 0.01 a-error levels, respectively. 



ERIC 



Question: BSYRQIOG. Have you participated In school subject matter clubs 
such as science, history » language, business or art, either In or 
but of school this year? ^ • • \ 



Response Category 



Have not 
participated 

Bave piairtlclpated 
Actively 

Rave participated 
as a^leiader or 
officer 



b/ 



Selected Statistics^ 



Estimated total 
for seniors in 
each category, 

LnoUaauQS 


Bias In 
estimated 
total,' 

Lnousauas 


Estlmated'^ro- 
portion of seniors 
, in leach category, 

percei^L 


. 2,040 


-162*** 


' 73148 ' . ' 


. (31) 


(35) • 


'(0.54) • 


625 


, , ,.■ I' 
-23 


22:i3 


(15) ^ 


(17) 


, (0.41) 


I 123 


-6 


4.39 


» r .. (6) , 


. , (9) 


(0.19) r 



Bias In,, 
estimated 

proportions, 
percentage 
points' 

-0.66 
, (0.96) 

0.55 . 
(0.46) 

0.09 
(0.18) 



Table 15. 



Question: BSYRQIOH. Have you participated in student council, studen't government 
: or political club, either in or out of school this year? 



Have not 


?,215 


. -182*** 


79.64 , . 


-0^78. 


participated 


\ (33) 


(43)- 


(0.4:^ 


(0.92) 


Have participated 


V. ^■■ '■'-.3a3 


-20** 


13.78 


0.23 


actively - 


(11) 


, (10).— • 


(0.32) 


(0.32) 


Have participated 


181 


2 


•6.58 


0,53*** 


as' a leader or 


(7) 


(8) * , 


(0.22) ^ 


(0.17)' ' 


officer 


\ 

l! 


V 







a/* - ■ ■ ' 

— Based on data from the NLS Base Year and First Follow-Up surveys, and the methodology 
of Section Proportions are based on Base Year methodology throughout, but a modi- 
fication in ^e handling , of "zero" schools was. incorporated to estimate totals (columns . 

. one and two), hence the estimated proportions do not coincide exactly to the estimated 
totals.. * . ^ * t . ■ I . ' • 

\i ■ ■ • ^ ■ ■ • v^-- • . ■ /:■ • • , ; ■ ■ 

— Standard deviations are presented in parentheses and *» **•> *** indicate statistical 
significance of the bias estljnates at the 0.10, 0.05, p/Ol a-erroi^ levels, respectively. 



ERIC 



Question:* 13I^Q^0I« Have you participated in vocational education clubs 
such as 'Future Homemakers', Teachers , /farmers of America^ DECA,* 
^ , OEA, FBLA, or VICA, either in of; out of school this year? 



♦Response Category 



Have not 
participated 

Have participated 
actively 

Have participated 
as a le^adet or 
officer 



1 



Estimated total 
for seniors In 
each category, 

thousands 

■ 2,1-38 ' ' 
(34) 

462 
.(13) 

181 

: (7) 



b/ 



Selected Statlstlcs- 



Blas In 
estimated 
. total, 

thousands 

-140*** 
(33) 

-51*** 
(19) 

-8 

(6) ' 



Estimated pro- , 
portion of seiilors 
in each category, 

percent 

^ 76,67 
(0.57) . 

16.-71 
(0.39) 

'6.62 
(0.21) 



Blas^lft 
estimated^ 
proportions, 
pepdentage. . 

points 

0,37 
(0.99) 

-0.61 - 
(0.58) 

.0.22' 
(0.25) . 



a/ 



Based on data from the NLS Base Ytear and First Follow-Up surveys, and the methodology 
of Section C . -Proper tioiis_.are based on Base Year methodology throughout, but a modi-^ 
flcatlpn in the handling of ^^zero" schools* Was Incorporated to es.tlmate tbtalS (coluims 
one and two), hence the estimated proportions do not coiiicide epcactly ^o the estimated 
totals. 



b/ ■ ' ■ ' ' ' ^ 

— Standard deviations are presented in parentheses iand *, **, '^^^ indicate statistical 
significance of the bias estimates at the 0.10, 0.05, 0*01 a-error levels, respectively- 





Estimated total 
for iseniors in 
each category, 

thousands 


/Bias in 
/estimated 
. / total, 

/ thousands 


Estimatied pro-. 
. portion of seniors" 
in each category; 

percent 


Bias in ... 
.1 estimated 

proportions, 
' yercentagje 

_ points 


Military Service 


89 

, ■ /, 


0 • 


3.21- 
(0.17) 


. 0.22 - 
(0.14) 


^Vocational/ 
trade school 


• ' 209 / 
(8) / 


-23** 

(9) 

> 


7.62 

(0.24) ' 


-0.21 
' (0.26) 


Bomemaker ' 


■ ■• , . ,49 . ' / 


-14** 

(6) 


- 1.79.: 

(0.12) 


-0.33**. 
_ (0 .13) 


/College 


/ 

1,594'. / ■ 
(30) 


-122*** 
(25) , 


' 57.27 

(0.65) , 


-0.22 % 

\ (0' 58) . 


.On-the-job ' 
training 


'34 ■ 


4 

(6) . 


0.93 
(0.07) 


- -0.10 ' 
(0.08) 


•Work 


' 414 ' 
(12) 


i20** 
t9) 


. 14.87 ' , 
(0.36) 


0.29 

(0.31) , 

... ... ■ s- . 


• 

Don't Know 


' 30> ; 
• (9) . i- 


-11 V 

. (10) 


10.99 
(0^.281 

• . . . ; 


0.39 

(0.30) 


JOther 


93 J 


J -8 ■ 
(6) 


3.32 ■ '\ 
(0.15) 


- • ■ . ■ 
-0.07 

(0.17) 



a/ 



Based on data from the Base Year and Firat Follow-Up surveys, and the methodology 
of Se'ction C. Proportions are based on Base Year methodology throughout, but a modi- 
fication' in the handling of "zero" schools was incorporated to estimate totals .(columns^ 
/onia and two) , hence the estimated proportions do not , coincide exactly to the estimated 
totala.. ; . • ' , . 



— ^ Standard deviations are presented in parentheses and *, **, *** indicate statistical 
significance of the. bias estimates at the 0.10, 0.05, 0.01 a-error levels, respectively. 



R^sppnse Category 



Before tenth ' 
grade , ' ' 

In. tenth grade. - 

In. eleventh 
■grade! 

This year 
Still undecided 



A 



■Estimated total'' 
for seniors In 
each category, 

thousands 

V 1,193 
;• (22) 

207 
(7) 

339 ' 
(9) 

519 
• (12) 

527 , 
(11) 



Selected Statistics— 
Bias' in 



estimated 
total, 

thousands 

-81*** 

(17) 

(5) 

-36*** 

(8) 
-37*** 

(11) 

-16 

(14) 



Estimated pro- 
portion, of seniors 
,ln each category, 

. percent 



I 



42.75 
(0.51) 

7.45 ■ 
(O.?0) 

12.14 
(0.24) 

18.67,. 
(0.31) 

18.9.9 
(0.32) 



•- Bias In^^ 1 
estimated 
proportions i 
'percentage 

' polnis. 

0.'04 
(0U9) 

-0.31*** 
(O.U). 

-d.4l**- 
(0.20) 

, '.-0.03 
(0.33) 

0.71** 

.(0.35) 



Tabl^ 19. 



Question: BSYRQSS. Do you have a ph^ leal conSlon that limits the kind or 
amount ot work you can do on a jol)? » 



r 

Yes 



2,636 
i (37) 

^ 152 
(7) 



-184*** 
(47) 

: -8 
(11) 



9||61 

.,, .(0.41) i 

5.39 
(0.22) 



-0,03 
(0,97) 

0.02 
(0.20) 



- Based on data from the NLS Base Year and Flrgt FoUpw-Up surveys, and the methodology 
of Section c. Proportions are based on Base Year methodology -throughout,' but a modi-); 
flcatlon In the handling, of "zero" schools was incorporated to e'stiimate totals (columns 
one and two), hence, the estimated proportions do not coliiclde exactly to the estimated 

' ■ " ■ totals. ■ '• ■ ■■ ■ 5'';* . ' ' 

. ■' ' ■ '■ 

— f Standard deviations are presented in ^parentheses and *, **, *** indicate statistical 
' significance of the bias estimates at the 0.10, 0.05, 0.01 a-error levels, respectively. 
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Itesponse Categ'Sry Selected Statistics' 





Estimated total 
for seniors in 
each category, 

thousands 


- Bias In 
estimated 
total i 

thousands 


Estimated pro- ' 
portion of seniors 
in each category, 

percent 


Bias in ' 
estimated'; 
proportions., 
percentage 

points 


AnerKtan Indian 


34 


1 


■ 1.25. ■" , ' 


g.i4** . 




\ /ON 

(3) 


, (7), 


^ (0.09) . 


/a A"?\ 

,(0.07) 


Black, Afro- 


265 


-25* 


.-9.64 


-0.29 


Amerlcah or Negro 


(13) 


/ICS 

(15) 


(0.41) # 


/rt AON ■ 

(0.48). 


Mexican-American 


86 


11 


3:13 . 


0.58** 


or Chicane ' 


(8) 


(13) 


(0.27) 


/A 10\ 

(0.2q) 


Puerto Rican . 


13 


2 


••■0.50 


0.11** 




(2) 


(13) 


(0.05|| 


* /A AC\ 

(0.05| 


Other Latin- 


22 


2 


.0.78 


O.IO** 


American 


(3) 




5^ /in 

(0,09; 


/A AC\ 

(0.05) 


Oriental or Asian- 


27 


-1 : 


0.97 


0.03 ' : 


American 


(3) 


(6) 


(0.10) 


/A Aa\ 

(0.08) 


Whitl^ or Caucasian 


2,267 


-176*** 


80.93 


-0.84 




, ^ (36) 


(44) 


(0.58) 


(1*91)^ 


Other 


80 


1 


A,'/ 2.80 


' 0.14^ 


I 


ir, (^K 




(0.14) 


(0,12) 








* ' ; ■ . 

■ „ „ ■- . - 





Baaed on data from the NLS Base Year and First Follow-Up surveys, and- the methodology - 
of Section C. Proportions are baseU on Base Year /me'^hodo logy throughout, but a modi- 
flcatlon in the handling of ''zero" schools was incorporated to estimate to taist (columns 
\one and two)^ hence the estimated proportions do not coincide exactly to the estimated 
totals. ' ^ . ' 



♦ ■ ■ 

Standard deviations are presented in parentheses and *, **^ *** Indicate statistical 
significance pf the bias estimates at the 0.10^ P<05, 0.01 a-error levels, respectively. 



. Response Category 



Selected' Statistics- 



Nd 
Yes 

Table 22. 



Bias In. 
estimated 
^proportions,, 
percentage 

points ' , 

-3.61***\ 
(0.69) 

3,59*** 

(0.93) 



Que-^tldh: BSYR^J9dA". "Whkt was the highest educational level your father or male 
guardian completed? • ' . 



Estimated total 


Bias In 


Estimated pro- 


for seniors in 


estimated. 


portion of seniors 


each category, 


• ' total, 


in each catego^, 


thousands 


',,r ' ■ ' 

thousands 


percent 




-1 9ft*** 




■ (12) 


(17) 


(0.37) 

ii 


2_,539 


-79* 


• 91.64 


(35) 


(42) 


(0.49) , . 




< . .ft vv^ y •■ 





Doesn't apply 



Did not complete 
"hilgh school 

hool or 
Adult eidiidatioil 




program 

Business or 
trade school / 

Some college 

f,. ' 

Finished college ' 

Graduate school 

J • • • • 

Graduate or 
professional level 



98 
(5) 

813 
(19) 

. .824>^ 

,' '42 
(5) 

160 

. (7) 

298 ^ 

, '286 
(10) 

■■I m . 

' ' (5) 

.-165 
(8) 



-8** ' * • ■ 3.65 

(3) ^ -,.(0.15) V 

-91*** 29.46 

(19) (0.46) 

-77*** 29.73 

(9) (0.'i5) " 

17*** 5.79 

(6) , . (0.24) 

-20*** ' 10.78 * 

(6) • y (0.26) 

-32**** ' . Id. .30 

(8), ,(0.29) 

6 . 2.79 

(4) f • -V.(0.14) . 

3 . ''h: ■ 5.94 

(4) (0.24) 



0.06 •', 
(0.14) 

-0.92 
(0,59) ' 

-0*41 
(0.59) • 

-0.40** . 
CO^ei ; 

,0.95*** 
1(0.22) 

0.11 

0.18) . J 

-O.3I 

(10.23), 

0.38** 
(0.15) 

' 0.51*'** 
(0.19) 



a/ 



Basdd on data from the NLS Base Year and First Follow-Up surveys, and the methodology • 
of Section C. Proportions are based on Base Year methodology throughout, but a modi- 
fication in the handling of '^zero", schools was incorporated to estimate totals i (columns 
one anda., two) , hence the estimate^ proportions do not coincide exactly to the estimated 

totais-iC' ■■'■'V.:'' --..-^^. . '■•■-^c^ . ■ . • 

standard deviations are presented in parentheses and *, '*?*.,■ *** iiviicate statistical 
significance of the bias ,^ estimates at the 0.10, 0. '0^y>6. 01 of-eifcor levels, respectiv^Lly..V^ 



Doesn't apply 



J 



.Did. not complete 
high school 

High school or 
equivalent 

Adult education 
program 

Business or trade 
school^ 

Some college 
Fiii'iished^ college ^ 
Graduate school 

:| : ■ 

Graduate or 
professional degree 



Estimated' total 
for seniors Iri 
jsach category, 

thous^ands 


Bias in 
estimated t- 
total, 

thousands 


• Estimated pro- 
. portion of seniors 
in each category, 

percent 


Bias in' 
estimated 
- propoift'ions , 
percentage 
points 


71 


'-10** 


. 2,56 


-0.15 


(4) 


(4) 


(0.14) 


(0.13) . 


. 702 / 




. ., 25.28 , 


.0.14 


(16) 




' (0.44) • , 


(0.53) : 


1,189 •• ,,' 


-107*** ' 


42.70 


\ -0.76 


(22J 


/ (29) 


(0.47) 


(0.54) 


•;69 


-19*** 


2.47 


-0.46** 


(4) 


• (7) 


(0.14) ^ 


(0.19)^i'. 


170 


14*** 




0.84*** 


(7) • 




(a.2i)^ 


4 1- 

. • . ^(0;14) j. 


' '278 


-15**. 


9.99 


0.17 i 




(6) '. 


(0.25) ' 


(0.17)1 


198 . ■ 


-17*** 


7.07 


,.--0.14*' 


(8) 




(0.25) 


(O.W 


• 50 ■ 


4** 


1.79 


0.25*** 


\i) 


(')\ 




(c\ ^7^ 


■ J, 

57 ^ ^ 










• -2 


. : 2.08 ^ ■ 


Q.08 * 


(4) , 


r (2) 


(0.11).. 


'($'^07) 



a/ 




Based on data from the/NLS Base Year^d First Follow-Up surveys, and the Methodology' 
*of Section C* Proportions are based 6a Bas^e Year methodology throughout , but a modi- 
fication in the handling of "zero" schools was incorporated., to estimate totals (columns 
one and two) , hence the estimated proportions do not coincide exactly to the estimated 
totals. - , r ^ , 

\ ■ 

" ' ? ^ ^ , ^ ■ ■ • . . 

Standard deviations are presented in parentheses and *, indicate statistical 

signifleance of the bias estimates at the 0.10, 0.05-^ 0.01 a-e^rrpjt /le^^ respectively. 



Response Category 



"I, 



Selected Statistics- 



■ • 


Estlinat;ed total 
for setiiors in 
e^ach. catego]^,, 

thousands 


Bias in 
estimajbed 
tota^.-, . 

thousandis 


Estimated pro- 
portion of seniors 
•>':in each category,;. 

p«cent 


Bias in 
estimated 
proportfons, 
percentage 
points 


'Quit; high sohopl 




0 • 


0,27 


0...04 


w/o graduating 


. (1) 




(0.04) 


jy A AAV 

(0.08) ■ 


Graduate from 


203 


. -6 


7.47 


. 0.43* ' , 


high school .: 


(7) 


(7) 


' (0.?3) . ' 


(0.25) 


Graduate from h/s 


571 




20.71- 


- -0.24 . 


then trade school , . . 


^" (16) • 


(13) 


- ; (0.43) ' ■ r 


(0.33) . 


Two>Try^^P;^^unlor 


' ■ • 268 


-22*** 


. 9.63 


^-0.08 


college^ "'^ • * ; 


(?) 


, . (7) 


. . (0.26) ■ 


(0.27) 


fPour-^year- college 


i;ob7 


-75***.'.', 


36.28 


-0.03 




' (19) 


[ (20) 


(0.45) 


(0.49) 


Graduate or 


321 V 


"' v. -35*** 


' 11. sb ' 


-0.41* 


professional '^chbol 


(11) 


(10) 


(0.31)' 


•(0.24) 


Don't know 


.:■ 391 • 


.21*** 


•14.14 


0.27 -i. 




(10) 




(0.30) . 

,• '. ^ . ■ . 


(0.21) ' 



a/ 



b/ 



Based on data from the NLS Base Year and First Follow-Up" surveys, and the methodology 
.of Section C..,' Proportions are based on Bas>! Year methodology throughout, but a modi- 
fication In th^ handling of "zero" schools was incorporated to estimate ^tals (columns 
one- and two), hence the estimated proportions. do not coincide exactly 'to the estimated 
".i;otiaXs.. ' . , • . ' ■ • 

• ■ ■ 

Standard deviations are presented in' parentheses and *, **, *** Indicat^' statistical 
significance of the bias estimates at the 0.10, 0.05, 0.01 a-errbr leVers',;Tespectively. 



then trade school 


(16) • 


(13) 


,(0.44) 


;|.35) 


Two-year Junior 


302 


-30*** 


10.81 


-0,28 


college , 


(9) 


(8) 


(0.27) 


(0.28) 


Four-year college 


1,045 


-72*** 


'37.60 


0.11 


1 


(M) 


(17) 


■ • (0.46)' 


(0,45)- 


Graduate or 


. 338 


-29*** 


12.1)1 


-0.21 


professional school 


(11) 


(9) 


(0.31 

• 


(0.21) 


Don't know 


284 


-20** 


10.23 


0.05 


4 


(8) , • 


(8) 


(0.25) 


(0.22) 



»/ 



Based on data from the ES, Base Year and' First Follbw-Up suneys, and the methodology- 
of Section C, Proportions are- based on Base Year methodology throjughout, but a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals. (columns 

one and two), hence the estimated proportions do not coincide exactly . to the, estimated 

totals. * * 

\ ... ' ' ♦ ; ' , 

hi \' ■'■ ' ■ ' 

- Standard deviations are presented in parentheses and *, **, *** indicate, statistical 

'sfgnificance of the bias estimates at the 0.10, 0.05, O.Ql a-error levels, respectively. 



Jewish 



Other 



None 



82 

(8) 

115 

(4) 

151 

(6) 



-6** 
(3) 

-6 . 
(7) 



2.89 , 
(0,27)i 

4.15 
(0.14) 

5.38 ' 
(0.20) 



0.19* 
(0.11) 

0.09 
(0.14) 

0.10 
( .21) 



BaseJ'oti data from the ES Base1(ear ani First FoUow-Up surveys, and the.ifethodology 
of Section C. Proportions are based on Base Jear methodology throughout i^'ljut a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals (columns 
one and two), hence the estimated propo'rtionlS'.do not coincide exactly to the estinlated 
totals. i ■ . 



b/ * 

Standard deviations are presented in parentheses and *, **, *** indicate statistical 
significance of the bias estimates at the 0.10, 0.05, 0.01 a-error levels, respectively 



■J' 

I 



M,000 -$ 7,499 


319 


A 

8 


1 A / 0 

10,48 


0.09 


flO) 




(0.29) 


(1.07) 


h <■ |i AA A A AAA 

\ 7,500 - $ '8,999 


AAA ' ' 

299 


21 


9.91 


A C£ 
O.JO 








(0.25) * 


(1.25) 


b AAA. A4A 1 AA 

J^jOOO^- $10,499 


A / A 

349 


V 

-14 


^ '^l 11/0 

11.48 


A ^0 


f 


• (11) 


(24) 


' ' (0.29) 


(0.44) 

\V ITT/ 

\ 


ffAA Ad4 AAA 

110,500 - $11,999 


A A C 

295 > f . 


-4 • 


^ \ 9.72 


A ^1 


• 


> / 


(37) " 

V 


yiiQ.27) 


(Ml); 


112,000 - $13,499 ' 


0 AC 

305 


13 


1A AA 


A 07 


(8) 


(47) 


(0.24) 


(1.52) 


1 •• A ^ AA A« / AAA 

113,500 - $14,999 


238 


28 


1 OA ' i 

■ 7.80 J 


A Q/. 


♦ ■ ■ 


(7) ^ 


(47) 


(0.22) ? 


(1.50) 


115,000 - $18,000 


000 

2oo 




r 

9.42 


A 00 
O.U 


no) 


(35) 


(0.28) 


(1.05) 


hrer $18,.000 • 


let 

456 


1 


1 /. AC 

14.95 


-U.UCI 


14 


(32) 


^ ft\ if\\ 
(0.40) 


/A QA\ 



■ Based on dat;a'froi the ES Base Year and First Follifw-Up surveys, and the methodology' 
of Section C . Proportions are based on Base Year methodology throughout, but a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals (columns 
one and two) , hence the^stimated proportions do not coincide exactly to th^e estimated , 
totals. 

i/ 

■ Standard deviations are presented in parentheses and *, *^ *** indicate statistical 
significance of the bias estimates at the 0.10, 0.05, 0.01 a-error levels Respectively. 



Table 29. . ' .■ ^1 , ( 

I 

Quealon: BSYRQ94B. Do your parents have a daily newspapeHn their home? 



Tea 



No ^ . 



■2,M3 


' -175*** 


89,41 


. • «.31 


,06) 


•• (45) 


(0.43) 


(0.99) 


' 291 


-31*** ■ 


10.59 


-0.34 


(9) 


(12) ■ 


(0.30) 


y ' (0.28) 



Table 30. 



Question: BSYIIQ94C. Co your parents have a dictionary in their home? 



Yea - 






..-192*** : 


98.29 


-0.05 






(39) 


;(49) 


(0.37) 


(1.02) 


No . 




48. • 


-1 


• 1.71*0 


0.05 


1 


i 


. (4) 


• (13) 


(0.12) 


(0.15) 



- Based on data from the NLS Base Year and First Follow-Up surveys, and the n^pthodology ' 
of Section C.- Proportions are basfed on Base Year methodology throughout, but a modi- 
fication in the handling of "zero" schools was incorporated to estimate totals (columns 
one and two), hence the estimated proportions do not coincide exactly to the estimatec 
totals. 



andard deviations are presented in parentheses and *, **, *** indicate statistical, 
significance of the bias estimates at the 0.10, 0.05, 0.01 a-error levels, respectively. 



Table 32.- 

Question A BSYRQ94E. Do your parents have magazines In-their honie? 

J * V ■ 

Yes* .^.w-^ 2,568 -173*** 92.23 ^0.22 

• .' (37) - (43) (0.41) - (0.88) 

No ' • ' 212 -21* 7.77 -0.24 

i ' UK (11) (0'24) (0.29) 




^Table 33. 



Question: BSYRQ94F# ' Do your parents h^ve a r(i(?tp player in their home? 



lies 



No 



2,671 ' 
(38) 


-185*** 

(46) V . 


95.86 

(0.39). 


0.05 
(0.97 


115 
(6) 


-9 

(11) ^ 


4.14 . 
(0.19) 


-O.OS 

,p9 



' Based on data from' the fILS Base Year and First Follow-Up suneys, and the methodology 
of Section C. Proportions are based on Base Year methodology throughout, but a modi- 
fication in the handling of "zero" schools was incorpor^ed to estimate totals (columns 
one and two)> hence the estimated proportions do not coincide exactly to the estimated 
totals. ' 

\ 

Standard deviations are' presented in parentheses and *,.**,*** indicate statistical 
significance of the bias estimates, at the 0.10, 0.05, 0.01 a-error levels, respectively. 



Table .35. 



Qliestlon;. BSYRQ94H. ' Do yofrpaftits have a wlor tekvlaion'iii thelr^hone?^ 



. ■ - . A- 
,1,735 ; v'il33*** 

i;020' .. :'f^i^^2*** 

k' *' / 



• Tes 



No. 



4 



; 62'i87 

37.13 • , ' ' 
(0.45)\ 



oJ*' • 
(0.81) ;„ 

-0.32 . If, 



Table 36. > 



§ie8tion'u^BStaQ94l.^ Do ydfijc jarents have a .typewritei: In t|^ir hone?' 



Tea 



^ No' 



2,286' ; -140*** 

^ ^ f(\ I '."508' 




J/ 



■ «).84) 

■ 18.20 V , ■ -O'.W 
, #36).v;J.. (0.32) 



l» „ > 



Ba9*ed on -data fron the ES'Baf fe Year and. Flr^^TsiiQiH and the;nietl!bdol'ogy. ' ' 

> *. of ^ecfejion C'V Prop'ortiotii are basfed on Baae^Yffir meth^ology throaghout/'htit a modi-, ; 
/^ficat^on tn:the;todliiig^of |eero'\scho(?l8|^^^^^^^^ to estimate' totals] (columns' ; 

■,. 'one and^two), he'nce the estimated pfoporti|bA*%'not dolncfde.^xad^^ to- the, estimated j /• 
• v.. totals.:' ' - ' , ?.X--' y^', . Vrf?— •... ■ ! 



t > 



M^'jSta|'dard deviatlon^WFeseiited'in parentheses iawl *, **', *** indicate stat«.s:t^,dal\ ; 
' sianthoance of the bias estimates atithe'O.lOf O 0.01 a-errpt levels , respecti?|ryi.- 



Table 38. 



Yes 



No 



Question: BSYRQ94K. Do your parents have two or more cars or trucks that run} 



2,103 


-139*** 


75.67 


(33) 


(39) ' 


(0.56) 


674 


-64*'** ■ 


24.33 


'v ill) 


, ■ (18) , ^' - ■ 


,(0.4?) 



.50 
(0.77) 

-0.52 
(0.54) 



\ 



Based on data from the NIS Base YeAfl|tti JH*^ Follow-Up suneys, and !he methodology 




of Section C Pimqrtions af^ h^Je^ on; BaW Year methodology throughout, -but a modi- 
-- ficatioihln the) h^^^ '-!ero" , Schools was incorporated to estimate totals (columns 
' one and twd),'hencd) the estimated proportions do not ((oincide exactly to the estimated 
' totals, 



K Stan 



ird deviations a\a presentid In parentheses and *, **, indicate statistical 
"■Icance of th^ bial estimates at the 0.10, 0.05, 0.01 a-error levels, respectively. 



JbVVf vuv 



Subutb of' city of 
50,060 - 100,000 , 

City of 100,000 - 
500,000 

Suburb of city of 
100,000 - 500,000 

City over 500,000 



Suburb of city . 
overSOOjOOO 



228 


> 

6 


AAA ^ 

8.29 


U.8Z*. 


(10) 


(12) 


(0.31) • 


^ '(0.43) 


V 

275 


-19 


in Ay 

10,04 


A 17 
U.i/ 




(U) 


(0.52) 


(0.51) 


M ^ A 

253 


-11 


A Ai ( 

9.21 






fl2) 


(0.36) ' 


(0.43) 


158 ^• 


, -13 


% P TA 

5.78 








(0.31) ' 


(0.42) 


201 • 




^ Ai 

7.31 


0.43 


(11) 


. (11) 




k\\ 



Baied^n dita from the 



oMcmvu uaua ..urn uuv »H»w,we Yeaip-flrtd First Follow-Up suneys, and the methodology 
of "Section C . Proportiowile based on Base Year ijethodology throughout , but a modi- 
Jication in tAe^handHng of "zero" schools was incorporated to estimate totals (columns 
' onri and two) , '(hence ^ the estimated proportions do not coincide exactly to the estimated 
'totals. ■ ^ ' " ' ' 



Standar/Mlat 
significance of yhe 



ire pres 



lelntOT 



, In parentheses and '5^, **, *** indicate statistical 
)'iaVestimates'af the 0.10,^.05, 0.01 a-error levels, respectively. 




ERIC 



^0 



V 



2.0^! Sampling Model for NLS Base-year Survey and Follow-up '« ?^ 

In a typical stratun, the four initial school selections verrinade without 
replacement and with probabilities striptly proportional to relative size' , ' 
measures ^ • * ' ' 

: ' . I [M] for large school strata 

•P(i). , (2.1) 
( [A(i)/A(+)] for remaining strata ' , 

where N represents the total number of s<:hpols in the stratum and A(i) denotes 

III ' ■ : 

a presuney estimate of the senior enrollment for, 8chool-i. Also, 

A(+) ■ rA(ip " , ' : 

The subsequent analysis will, proceed as if the number of schools asked 16 
cooperate In a t;ip,ical stratum, say n, were fixed. In fact," however J' for with ' 
replacement school selections, one can show that n has tjie truncated negative 
Mnonlal distribution with R» I P(l) corresponding tij. the probability • , 

, , ieR ' ... - ; 

of a success where 1^ represents the set ,bf schools which would cooperate 



3 



.2 



_ .-...JI i£.i_- J,-n «„L. 

2R^(1-R)'tf a - 2,:n M 
3R^H)^ If D ■ ?,JV'*'4' 



\ 0 otherwise' V 



From the Joint distribution of i^and n k (2.3) one obsenes that 
■ m ■ 4R(l-R^ + R^/2)' ■ REdi)" 



and 



J, 



2 



(2.3) 




Var(in),*. '2R (6-8R;+ 3R ) ■ RE(ii)[llE(n) - 1]..,. 
While it is clear that 

, [ {E(ni)/E(n)} - R 

tke usual estimator for R, nainelyrRf '^(ffl/n)', is biased. Firoi (2.3) ohe obtains 
Edn/n)- R'+ (S^R)' rVr)/6' . ' ' , ' (2.4) 

While the analysis above 'l^^lcates that thete are some problems associated with, 
the assumption that nls fixed, (whenf in fact, it is , a random vatlable with a, 



» . ^ere, obtained. Subsa^pling of nonresponding school aus^ be allowed 
since noncooperatlng backup schools were not included in the follow-up. 

3.Q Bias Estiiaation for Base-year, Totals ; \ 

■The "biased" schoornonresponse" base-year estimate for a final 'stratum total 

• ' ' \ 

with m > 0 can 'be represented as foUowsi , ' * • ' 

■: •Y(B)- ,C(n/« ^' fi(l)H(t)/nP(d^ ^ / ^ (^^D 

I ^ : ' iml ( ■ 



•ft* «^ 



' whe 



ERIC 



C Y(R)/R 



p(i) = 1 if sample school-i participated in the base-year and 
zero otherwise; 

A ^ 

Y(i) = an estimated total for schoo'l-i based on a simple 
random sample of approximately 18 seniors; 

Y(R) = an unbiased estimate of the total among the set K 
of cooperative schools in the stratum; 

R = (m/n) » I p(i)'p(i)/nP(i) is aii unbiased. Mtimate 
i«l ' ' ^ ' 



r 



for R the relative size measure for the set;R of 
'cooperative school?. - 



1 if schdol-1 Initially refuses and Is sujsseiiuently 
Selected for follow-up , / .', ' 

0 otherwise. ; >J: v \' *. 



'l{:.E-( |b) denotes expectation over Ahe'. pet 9:1 subsamplis for a/"^ ; 

given- base-year aaipl'e, ijheh • * ' , , 



■' 4 

and 



UlMi] ' Y(R) - I tH(i)l TW/nPd) . , (3.3) • 

: ' ■ i'l :.. • 

, •■. ■'• • 

ffie estloatgr foi Ul) in' (3.3) Is olivlouslrunblasell. Hben at least, boe foUov- 
uo response is obtained, an unbiased^- estimate for the population total Y ■ Y(R) + 
Y(U) can be estimated by adding, the coi|?sponding statistics from equations (3.1), 
and (3.2),,naiBiely 

: , Y - Y(R)+Y,(R) . ' . ' . ■ (U) 

When there are nonqoOperating base-year schools (n-ffl>Q) and no follow-up , , 
responses are AbtainW (s-O), foiow-up responses from neighboring strata can 



,,{'3.' ■ * 



. repiacement variance approximations are obtained by sub8titutii|;^estiiiia||tt', . ^ 

• school totals Y(i) Into the ap||oprj|te single sta^yari^ance estima'tors. 

Such esti:inators: include the , proper contribution for within -school vari^- 

ability and overestimate the, between school component due to ignoring 

/ the ' finite popuUtion correction at this stage. The single stage analysis 

^that follows will lead, therefpre, to single gtage variMjce- estimators, 
' . ... V r * "^^ ■ • 

which will then be used along with estimated school totals to approximate the 

variance for the NL^Vtwo-stage bias estimate in equation i3*5)\ 

' To specify, the prlW^ of bias{Y(B)} ci>nditional expi||ation8 and variances 

will be derived over all,poMble follow-up subsamples for a given-,base-year selec 

tion of schools. These -ciiditional expectation, and variance operations ^1^^"" 

depicted' by |B>;and Varp( |b) . With Ej( ) and Varg( ) denpting expected 

valjies and vari^ce^, with respect to the base-year school selection, one 

can write \ • 

■ Var{bla3[Y(B),l}rVar^Ej{bk3[Y(.B)]|5} + Ej.Varj|^^^^^ (4.1) 

Secalllng equation* (3.4) ani (3.5) one observes that t ' . 



ybW(B)^} - C ^(R)/R - Y(R) - Y(?) ■ \ ■ W.2). 



r 

ERIC . . ; : * ^ 



J • • • 1 1 



The first tenn in (4.1) is therefor/ 



(4.3) 



N 



Var^Ubias[Y(B)|B}- I Hi) ' 
^ ^ i-1 . 



t2 



Z(+) 



/n 



( 



where 



N 

m- 2 z(i) 

i«l. 



2 Y(i) ■ -Y 
i-1 * 



'(4.4); 

■ 

I.; 



Letting 



I 



\ Pp(i) - P(l)/R • A(i)/A(R) , ■ i 

denote the conditional probability of lelecting a school-1 on u Specific draw 



given that school-i belongs to the set R of 'cooperative schools, tSe expression 

rV' 'I. ■ 

in equation (4.4) becomes with substitution for Z(i) from (4^) , ^ 

N ( t H » L... 1 12 

DPd) Gp(i) . 



i 




/n 



T 2 




r2 



+ E P(i) 
i-1 ; 



P(i)- " 



12 



-V- * / '-J 



^ '.ill 



I. 4 



/n 

4 



-2CI Pj(l) 



• Yd) 

Pr(1) 

» 



P 



- Y 



Bdmg schools, tor toiiowtrup, oDserve tnac 
'^%WB)]|B} " Vary{Yj(S)|S} , ' 




^«|Wl<ng of .Y-(K) froiii equation (3.2), 1M) can be recast a$. 




l)],Y(l)/s?(i) , 




xThe sua f ollovlng /(M) in (4,6)16 tte'kverage of. TUi)/?^^^^^ over the s InitMy' 
nonrespondiMjphoiDffs;Shlch partJpipateNt^n the f j^lw-up,. fi^ng the jc'f 
• initiri non^spondents^s a nopuiatiQH fr&Xhitn s members yere leleited via 
simpUriddom ilpplijig 'idth'y(k)v» Y(k)fP(k) thl^bs^rved teiafe valijrM^ 
>ky thenJtha su3[^ {|i\) tan he/Witten'afi 





' ' and thecefoci 






I 



r I, 

ERIC • 



E {yJ)|B} •y(k)?^(n-m):-. t Y(klj^n-m)P(i)" 



i-1 / 





lnc6T;ti^ (M)||i5)j^the^ conditional var/nce of for a given base 

has the fonn,above)!&th. dfeleted from the denoil- 



€a'r school sejfici 



natot. ^th Y representing the nomber of nonresponding primary schools from 



a. typical str-atun, thSJeffllcted value of s over all po^ible base year selections 
Is E^) f 2(M). Ae^jipfecfied value of the double sum pf squaref differences 



lnVarj(yj(K)rBtlbovf;is 

' ■' \ ■ ' lyh) P(j).[i-P(i)][i-P(j)]ty(i) - y(J')l^ 

' Using PpCi) ■ 'P\'M1-R) to denote the relative Sizes among the population K 
' of Apijjad^eratiW schools, the quantity afiove can be recast as 




^'Conbitiing these results, ths second tern In the variance of bias [Y(B)] is 
(jj^oxluiately , ■ . ' ^ 



of respond^g R and nonresponding R schools. The denotes the covarlance 
type compoient from equation ^4.5).. Recalling the definition ^of the covari&ce 
component in equation (4,5), one can show that ■ cj^i /R which leads to^ 

.Var{bias[t(B)]P (C^-2RC)t|^VE(m)R^+ a^^/n ^ 



,/[ M)(n-2) 



2(n-nR-l) 



2/ - 
On /n . 



I ■ 





An alternative form for equation (4.10) canjN obtained by Mserving'tfet ' t^-. 



The equality abovjs leads to 



Var{bias[Y(B)]} 



7E(m). + .ajj^/E(n-m) + RU-W " jSJ 



\ 



r(n-l)(n-2)1 2, 





n 



^. • i=l 





- ^y(i) -.Y(i)/P(i) 

and 1^ 

• Y(R)/R = I pWYaf/mPd) 

then ^ 

* 4 V- I [zb ^ J]^/n(n-l) . (5.3) 

estimates the variance of bias[Y(B)] when all (n-m) nonresponding schools are 
followed up; that is, when .there is no subsampling of noncooperating sclUls. 

,, *^ - ^ * - ' 'I 

When there is subsampling, then Y(i)' is not available for all n schools, 

' ' ' 

initially asked to participate. In tltis situation it is necessary to estimate 
(5^) based on the follow-up subsample .results , and to add an additional term 

I iff ' • 

to in^clude 'the subsampling variability. To see how (5.3) can be estimated, 
it isilielpful to expand 4 /n liising the definition of z(i) as follows 

3' ■ . 

. v A ^/n »' i {Cp(i>[y(i1 - y J/R - [y(i) - yl}^n(n-l) ^ 

z i.l ' ■ ^ ^ 

■ ' ■ - ^p{i)[y(i) - yj -Wn-W ^ ■ ■ 



I ^ - 7ia(n-yR ^2C(iB-l)4 7in(n-l) + i h ' 

' ' - {C^-2rC),(i-1)A + ^ ^/n . (5'5)" 

■ r y . # . ■ 

- / ■ , 

The first term in ;(5.5} can be estkated directly from thfe base-year respondihg 
schools. For str4;ta |lth in " 1 responding school, the first tern in (5.5) 



will drop out since (n-l)4 ■ 0. When m " 0, no such term appears, In the 
variance estimator. The second term In (5.5) can be expanded further as follows: 

',11 {p(i) ^ IHimiii) + [1-P(j)]}[y(i) ^ y(j)]^/2n (n-1) . 



y 




Exploiting t^8_^ntlty one ohl^^iS^ \ . 



rh' I I p(i)p(j) [y(i) - y(j)l72n'(n,-l)' 

y ■• i»i j*i » ' 



+ *?■ 'p(i) I [l- p(j)][y(i)-y(J)]^/nV-l) 
i-1" .j*i ■ ■ ^ 



+ ' I I [1 - p(l)](l - p(j)][y(i) - y{j)]W(il-l).. ■ (5.6) 
i-1 J»i 



Letting 



• : I- ^ 

n ' \ 

h - I yj) [1 - .P(j)]y(j)/s and' • . , t 




• -4-^ - ' l AJj)[l-p(J)][y(j) - y-]^/(s-l),.the 
j-1 ^ . 



second term estimator in (5.9) btomes 
. n n 



, (1-R) I D(i) I L(j) [1-: (j)]{[y(i)*y.] - [y(j)-y:l + b^-y^l^ 



- R(l-R)(4-l)i ^/ffl(n-l) + R{l-R)(s-l)i:^/s(n-l) + R(l-R)lr -'.y.] /(n-l). 

r . r t c 

■ • , ■ . . ' 

< • . . ' (5.10) 

Noting that 

• I I L(i)'L(j)[l - P(i)l[l - p(j)][y{i) - y(j)l^^/2s(s-l). 

' 1-1 J*i " . . • 

the third term in (5.6) can be estimated unbiasedly by ^ 

(l.R)(n-m-l)4-7n(n-l) (5.11} 
r 



A A 



+ R(H)(y^-y-)^/(n-i) . 



(5.13) 



To estimate the subsampling component of variation in bias[Y(B)], the relations 



Var 



,{bhs[Y(B)}|B} ^,VaUVR)|B} « (l|)V,{5,(i!),|Bl 



•^»are useful, where in the shorthand nota'tion lised in (5.13) y (!!)» y- 

I 

Recalling that the s f ollowriip schools represent a flmple rahdoin sample, 
from the' (n-m) 'initially uncooperative schools, one notes that 



1 - 



is IHj^bi^sed^ estimate (or Var^ 
Therefore ' 




(5,14) ^ 



and in tutn for ?jVary{yp(K)fB}. 



EJarJbias[Y(B)]|Bl » (H) (n-!fli-s)4- isn . 
D i r 



(5.15) 



\ 



I* Adding (5.15 )ao (5.13), the required variance estimator is 



S(B)- l5(h)Y^(h)/R(h)/^rC(h)X^m 

where * ' • • " 

n(h) . / 
•X^(h) =• I p(hi)X(hl)/n(h)P(hi) 

with X(hi) denoting, for example, the' estimated nmber of black, seniors tn 

sample school-i of final stratum-h. The \W) total for stratun-h«is defined 

similarly with Y(hi) depicting, for example, the estimated number of black , 

seniors in school-hi who w6uld respond to an NLS question in a particular 

way. For this example 9(B) represents the biased estimate for the national', 

proportion of black seniors who would respond to. a particular ES question 
'iff 

in a specific way. Letting 

Y (h) i C(li)Y,j(h)/R(h) and Xj(h) - C(h)Xj(h)/R(h) , ■ 

. 9^) : I Y,(h)/ E L{h) - Y(B)/X(B) . < " ' ■ (6.2) 
h-l ^ ■ , h-1 " ^ 



H Ha 

\i m'l I x(h): 

h-1 h»l 



, • ;: ' t . 

Coibinlng the estimators in (6.2) aad (6.3) the school nonresponse bias in 

8(B) is estimated by; 

r 

bia8[9(B)T- e(B) - 9 - I®- -4- V (6'^) 

X(B) X ■ ^ 

To determine, a variance estimator for the bias measure in (6.4), a 
separate linearization can be formed for the two ratios e;(B) and 9. The 
combined'linearization for bias [9(B)] will be the difference between the twi 
separate linearizations. Taking partial derivatives of 9(B) with respect . 
* to Yjj(h), ^i\i)y and R(h) one obtains 

Lj(hlt.-C(h)p(hi){[Y(hiH(hl)yh)] 

re(B)[X(hl)-P(hl)ij(h)]}/R(h)X(B) . 



1 



«whick leads to 

Uhl)- C(ti)p(hl)[t(hlK(h).l/R(h)". ' • • . (6-5) 



Taking partial derivatives of 9 with respect to YJh), Y g(h), Xjj(li) and'Xpjj(h) 



one obtains" 



A A 



L(hi) ' [Y(hl) - eX(hi)l/X 



A 



and 

■V i(U) " [y(hi) - 9x(W)]/X . ' / 
Subtracting (6.6) from (6.5) yields 

v(hi) - yhi) ■ m ' .C(h) p(hl)[t(hl)-tj(h)]/R(h) - £(hl) , 

the linearized value for estiuating, VarjEj.{l)las[9(B)l|B}. Using the expansion 

■J 

developed in (5.4r'one finds that ' • . 

A^^^h)/N(h) *4^h)[ia(h)-l].iJj;(h)/in,(h)[n(h)-l]R(h) 
- 2C(h)(ffl(h|.l] 4^ (h)/D(h)[n(h)-l]/ 



+^1 



- R(h)][n(h)8(h) -nW - 8(lr)]ijj (h)/8(h)n(h)[ii(h)-l] 



2 



+R(h)[i-R(h)][Zjh) -i-Mim-iy. 



.( 




Now, eqtitlons (6.7) and (6. J) will be combined and simplified. Defining 



4 * A ' I 

w(hi) [C(h) t(hiH(ii)i(W)] , 



th^ sum of equations (6.7) and (6.8) is 

i (h)/n(h) « [i(h) -l']C(h)/a(h)[n(h) -l]R{h) , 

' ' + ^- R(h) ] [n(h)fl(h) - m - 8(h) ]i^jOi)/8lh)n(h) [n(h) - 1] 

\ +R(h)[l-R(h)]l(h)-!-(h)l^/ln(h).:i].. , j[6.9) 

To complete the variance estimator for bias[9(B)] Qpe obtains by analogy with 

If 

(5.15) ■ ' „ ■ ■ ■ ■ 

, ■ 'I 
■ E Var {bia8le(B) ] |b} - [1 - R(h) ] [n(h^ - «i(l» - s(h) ]^ Jj(h)/n(K)f (h) , 



w(hl), - G(h)[y(hi) - 9(B)x(hI)]/X(B) - R(h)[y(hi) - 9x(hi)I/X 



£(hl) • [y(hi) - ex(hi)]/X 



/ (h) . I p(hl)[w(hi) -w(h)]'/[i(h) -1] ■ . 



w (hj - -i; p(hl)w{hi)/i{h) 



4%(h) ' I \p(hi)[i - p(hi)[£(hi) - i-(m im -I] 



n(h) 

!-(h) - I L(hl)[l- p(hl)K(hi)/s{h). 
i'l 




• . I (h) I' p(hi)£(hi)7in(h). • , * 

Examining the variance estimator in (6M1') it is clear that the first term 

involving im(h)-l]4 (h) drops- out when m(h) ■ 0 or 1. When 8(h) [the number 

pf failow-up schools^' is less thkn [n(h) - m(h)], the number of* initially , ' ' 

^ ! . \ ' " i 

uncbopetative schools contacted in stratum-h, then sl^h) must be two or grealfer . * 

■ j>l ■ « . ■ ' ■ 2 

to prcii^i^e a subsampling variance^ component estimate A^jCh). If s(h) ■ 1, - 



.8tratum-h should, be collapsed, with a neighboring -stratuo-l^' .so ' that 
8(h) + a(h.'). i l and a pooled%timate.4«-(h+h') can be prodncgcL Whent ; , 
'[n(h)-m{h)] > Q. arid sCh'i = 0 both Z-(h)- and 4?-(h) iust be borrowed from a 
neighboring styatum. 

).0 Testing for School Nonresponse Hlas 

•• ■ With .the variance estimator proposed in equation (6^), a normal/ theory 
test fop sigjiif leant, school nonresponse bias can t)e performed. Two additional 




.,1 * tr 

statistics which my be of interest are. the relative bias , , 

^ el-bias [9(B) ]^ bias (9(B) 1/6 - ■ i f 

-and the "so-called" bias ratio ' ' i. ' , 

bias-ratio [9 (B)|J - bias [e(B)]/var[efB)] . • 'y ' # 



' The hias-ratio can be used to determine the impact of bias on the probaTblllt^ 

' ■ ' .■ - ■ ' ■ - ■ ■ ' ■ ■ # 

that a confidence interval of the farm # • ' t.' 

-v, 9(B> + KVar[§(B).] . , . . " \ ' ' ■ • ' 

will contain the true population value 6. the relative b|ps and bias-ratio 
meaStires can be averaged over Similar statistics to provide summary bias 
indicators. ' . 

. . .-i^ ..... -: ' • .■ i , " . 4 ■ 

o ■ ■ 
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